Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,326 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

12326 Commits

Author SHA1 Message Date
Konstantin V Shvachko 8b3b3aac10 HDFS-11634. Optimize BlockIterator when interating starts in the middle. Contributed by Konstantin V Shvachko. 
(cherry picked from commit 8dfcd95d58)
 2017-04-17 17:09:38 -07:00
Zhe Zhang 07047335a3 HDFS-11615. FSNamesystemLock metrics can be inaccurate due to millisecond precision. Contributed by Erik Krogen. 
(cherry picked from commit ad49098eb3)
(cherry picked from commit 051ab77806)
 2017-04-17 16:36:21 -07:00
Junping Du 0de6f28020 YARN-6304. Skip rm.transitionToActive call to RM if RM is already active. Contributed by Rohith Sharma K S. 
(cherry picked from commit 6ed9d36224)
(cherry picked from commit 9289f4527d)
 2017-04-17 15:59:00 -07:00
Arun Suresh 5970e8297d HADOOP-14311. Add python2.7-dev to Dockerfile (Allen Wittenauer via asuresh) 
(cherry picked from commit 0ac17dc644)
(cherry picked from commit 8515d35bd5)
 2017-04-14 16:59:25 -07:00
Jason Lowe a61ec7c374 YARN-6480. Timeout is too aggressive for TestAMRestart.testPreemptedAMRestartOnRMRestart. Contributed by Eric Badger 
(cherry picked from commit 4168805502)
 2017-04-14 17:18:08 -05:00
Eric Payne d27f74d915 YARN-5994. TestCapacityScheduler.testAMLimitUsage fails intermittently. Contributed by Eric Badger 
(cherry picked from commit 157a9f3104)
 2017-04-14 11:54:30 -05:00
Wei-Chiu Chuang ecaedca5c4
HDFS-10506. OIV's ReverseXML processor cannot reconstruct some snapshot details. Contributed by Akira Ajisaka. 
(cherry picked from commit 14414705f7)
 2017-04-14 21:11:31 +09:00
Junping Du c43ee00587 YARN-3760. FSDataOutputStream leak in AggregatedLogFormat.LogWriter.close(). Contributed by Haibo Chen. 
(cherry picked from commit c26ccf1adb3a72df3f68e1150b86b813c691203a)
(cherry picked from commit 9d9087a67a)
(cherry picked from commit d77cada182)
 2017-04-12 14:17:04 -07:00
Mingliang Liu 9eebbcf459 HDFS-11558. BPServiceActor thread name is too long. Contributed by Xiaobing Zhou 2017-04-12 13:39:20 -07:00
Kihwal Lee 9dfe0b3515 HDFS-11648. Lazy construct the IIP pathname. Contributed by Daryn Sharp. 
(cherry picked from commit 8ed230c805)
 2017-04-12 13:30:41 -05:00
Chris Nauroth c4bf504395 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 00ed21a6fedb45a7c8992b8d45adaa83f14af34c)
(cherry picked from commit d5e2bd4096)
 2017-04-11 21:55:28 -07:00
Steve Loughran 32475a7b6c HADOOP-14066 VersionInfo should be marked as public API 
(cherry picked from commit 2ed65540a3)
 2017-04-11 15:06:45 -07:00
Junping Du dfac95a3a2 Preparing for 2.8.1 development 2017-04-11 11:21:49 -07:00
Jason Lowe c5b1a8910d YARN-6461. TestRMAdminCLI has very low test timeouts. Contributed by Eric Badger 
(cherry picked from commit 90d97372ed)
 2017-04-11 09:18:56 -05:00
Andrew Wang c8d494197f HADOOP-14293. Initialize FakeTimer with a less trivial value. 
(cherry picked from commit be144117a8)
(cherry picked from commit dab1deb9a0)
 2017-04-10 11:37:35 -07:00
John Zhuge fa8e411d47 HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge. 
Signed-off-by: John Zhuge <jzhuge@apache.org>
(cherry picked from commit 56e81f2a20)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
 2017-04-07 15:05:09 -07:00
Zhe Zhang ef8b30dd4b HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen. 
(cherry picked from commit 95b7f1d29a)
(cherry picked from commit c85026038a)
 2017-04-07 10:52:02 -07:00
Xiaoyu Yao 6367bc1f09 HDFS-11608. HDFS write crashed with block size greater than 2 GB. Contributed by Xiaobing Zhou. 
(cherry picked from commit 0eacd4c13b)
(cherry picked from commit 0391c92022)
 2017-04-06 16:26:57 -07:00
Andrew Wang b1dfdea5b4 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-06 14:39:56 -07:00
Jason Lowe 6e41aec109 YARN-6288. Exceptions during aggregated log writes are mishandled. Contributed by Akira Ajisaka 2017-04-06 16:26:24 -05:00
Andrew Wang ab91ca7338 HADOOP-13688. Stop bundling HTML source code in javadoc JARs. 
(cherry picked from commit 72a2ae6452)
(cherry picked from commit 832c2f52f8)
 2017-04-06 13:16:15 -07:00
Junping Du f7a35c6489 HADOOP-13996. Fix some release build issues, include gpg timeout and disable sign for hadoop-dist. Contributed by Andrew Wang. 
(cherry picked from commit 98759b426c)
 2017-04-06 13:06:50 -07:00
Andrew Wang d12a0a25b4 HDFS-11538. Move ClientProtocol HA proxies into hadoop-hdfs-client. Contributed by Huafeng Wang. 
(cherry picked from commit e154893d3b)
 2017-04-05 16:36:07 -07:00
Wei-Chiu Chuang eff4b2fa07 HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge. 
(cherry picked from commit c5ca216915)
(cherry picked from commit 434403a2a0)
 2017-04-05 16:35:49 -07:00
Xiao Chen 7ad5b278a7 HDFS-9276. Failed to Update HDFS Delegation Token for long running application in HA mode. Contributed by Liangliang Gu and John Zhuge 
(cherry picked from commit d9aae22fdf)
(cherry picked from commit 24d464a150)
 2017-04-05 16:35:44 -07:00
Jing Zhao e216c15625 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. 
(cherry picked from commit 55796a0946)
(cherry picked from commit e03d8ff488)
 2017-04-05 16:29:04 -07:00
Andrew Wang ab673aa6cc HDFS-11629. Revert "HDFS-11431. hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider." 
This reverts commit 72fbdf708e.
 2017-04-05 16:26:57 -07:00
Xiaobing Zhou b9b6bd2932 HDFS-11628. Clarify the behavior of HDFS Mover in documentation. Contributed by Xiaobing Zhou. 2017-04-05 15:34:27 -07:00
Varun Saxena bf2c63ce46 YARN-6437. TestSignalContainer#testSignalRequestDeliveryToNM fails intermittently (Jason Lowe via Varun Saxena) 
(cherry picked from commit 7d963c477a)
 2017-04-06 02:09:32 +05:30
Jason Lowe ab231f5e1c YARN-6403. Invalid local resource request can raise NPE and make NM exit. Contributed by Tao Yang 2017-04-05 12:36:26 -05:00
Karthik Kambatla 9c1cf63a2d YARN-6436. TestSchedulingPolicy#testParseSchedulingPolicy timeout is too low. (Eric Badger via kasha) 
(cherry picked from commit 9cc04b4708)
 2017-04-05 10:04:36 -05:00
Varun Saxena 4fb72699ff YARN-6420. RM startup failure due to wrong order in nodelabel editlog (Bibin A Chundatt via Varun Saxena) 
(cherry picked from commit 19b89c4c7b)
 2017-04-05 09:43:36 +05:30
Mingliang Liu e47c95ffbf HADOOP-14268. Fix markdown itemization in hadoop-aws documents. Contributed by Akira Ajisaka 2017-04-03 11:15:03 -07:00
Wei-Chiu Chuang f9d3bb3b83 HDFS-11515. -du throws ConcurrentModificationException. Contributed by Istvan Fajth, Wei-Chiu Chuang. 
(cherry picked from commit bc7aff7cec)
(cherry picked from commit 4f1f16f1a6)
 2017-04-03 07:39:41 -07:00
Eric Payne 800d632caa YARN-6354. LeveldbRMStateStore can parse invalid keys when recovering reservations. Contributed by Jason Lowe 
(cherry picked from commit 318bfb01bc)
 2017-03-31 12:37:15 -05:00
Mingliang Liu 14e5a8ed28 HDFS-11592. Closing a file has a wasteful preconditions in NameNode. Contributed by Eric Badger 
(cherry picked from commit e5f0622a6f)
 2017-03-30 15:47:21 -07:00
Jason Lowe a351a30d9d MAPREDUCE-6850. Shuffle Handler keep-alive connections are closed from the server side. Contributed by Jonathan Eagles 
(cherry picked from commit c8bd5fc7a8)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/main/java/org/apache/hadoop/mapred/ShuffleHandler.java
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-shuffle/src/test/java/org/apache/hadoop/mapred/TestShuffleHandler.java
 2017-03-30 11:15:25 -05:00
Akira Ajisaka 6e005ad326
HADOOP-14256. [S3A DOC] Correct the format for "Seoul" example. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0d053eeb30)
(cherry picked from commit bb187e145a)
 2017-03-30 18:13:55 +09:00
Zhe Zhang 0acf2bca9c MAPREDUCE-6873. MR Job Submission Fails if MR framework application path not on defaultFS. Contributed by Erik Krogen. 
(cherry picked from commit de7efd2687)
(cherry picked from commit 3f5dc51ec9)
 2017-03-29 22:19:50 -07:00
Varun Saxena a2020024e2 YARN-6352. Header injections are possible in application proxy servlet (Naganarasimha G R via Varun Saxena) 
(cherry picked from commit 3fe7d36e72)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-web-proxy/src/main/java/org/apache/hadoop/yarn/server/webproxy/WebAppProxyServlet.java
 2017-03-30 04:06:54 +05:30
Mingliang Liu ba3a726988 HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu 
(cherry picked from commit 13c766b62c)
 2017-03-29 11:23:46 -07:00
Andrew Wang 7b8f87eb78 HDFS-9705. Refine the behaviour of getFileChecksum when length = 0. Contributed by SammiChen and Kai Zheng. 
(cherry picked from commit 82b4a9c3d0)
 2017-03-28 21:41:10 -07:00
Varun Saxena 5e751f3367 YARN-5368. Memory leak in timeline server (Jonathan Eagles via Varun Saxena) 
(cherry picked from commit 01aca54a22)
 2017-03-29 02:01:53 +05:30
Jason Lowe b1f0bde5dc YARN-6359. TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition. Contributed by Robert Kanter 
(cherry picked from commit bea8f8190f)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/TestRM.java
 2017-03-28 09:54:55 -05:00
Masatake Iwasaki ca3ede5fda HDFS-11486. Client close() should not fail fast if the last block is being decommissioned. Contributed by Wei-Chiu Chuang and Yiqun Lin. 2017-03-28 18:15:09 +09:00
John Zhuge c543c0549d HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge. 
(cherry picked from commit 253e3e78ab)
 2017-03-27 23:08:03 -07:00
Wangda Tan b218676b15 YARN-6339. Improve performance for createAndGetApplicationReport. (Yunjiong Zhao via wangda) 
(cherry picked from commit cd014d57aa)
 2017-03-27 14:05:54 -07:00
Jonathan Eagles ec5a65a0ca Configuration#get return value optimization (jeagles) 
(cherry picked from commit e41aac0cd4)
 2017-03-27 12:53:42 -05:00
Jonathan Eagles 4e40e9d4db Delay construction of PreCondition.check failure message in Configuration#set (jeagles) 
(cherry picked from commit 858d597be0)
 2017-03-27 11:06:41 -05:00
Junping Du 19d479168e MAPREDUCE-6868. License check for jdiff output files should be ignored. Contributed by Akira Ajisaka. 
(cherry picked from commit 945b006fe8)
(cherry picked from commit 0e8beb214d)
 2017-03-26 23:19:49 -07:00