Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,345 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

10345 Commits

Author SHA1 Message Date
Walter Su 0f5aae5fd8 HDFS-9410. Some tests should always reset sysout and syserr. Contributed by Xiao Chen. 
(cherry picked from commit cccf88480b)
 2015-11-13 14:29:25 +08:00
Wangda Tan 875aec3177 YARN-1509. Make AMRMClient support send increase container request and get increased/decreased containers. (Meng Ding via wangda) 
(cherry picked from commit 7ff280fca9)
 2015-11-12 11:50:41 -08:00
Wangda Tan 13f8c7093b YARN-4347. Resource manager fails with Null pointer exception. (Jian He via wangda) 
(cherry picked from commit 7f55a18071)
 2015-11-12 11:24:04 -08:00
Wangda Tan 0c1fb15b29 YARN-4287. Capacity Scheduler: Rack Locality improvement (Nathan Roberts via wangda) 
(cherry picked from commit 796638d9bc)
 2015-11-12 11:12:11 -08:00
Haohui Mai 5d9212c139 HADOOP-12562. Make hadoop dockerfile usable by Yetus. Contributed by Allen Wittenauer. 2015-11-12 10:20:33 -08:00
Jason Lowe 9050078005 YARN-4345. yarn rmadmin -updateNodeResource doesn't work. Contributed by Junping Du 
(cherry picked from commit 06a70311b9)
 2015-11-12 14:49:55 +00:00
Sangjin Lee 3214c2331f MAPREDUCE-6540. TestMRTimelineEventHandling fails (sjlee) 
(cherry picked from commit 9ad708a0df)
 2015-11-11 16:22:28 -08:00
Kihwal Lee 8726a5e020 HDFS-9396. Total files and directories on jmx and web UI on standby is uninitialized. Contributed by Kihwal Lee. 
(cherry picked from commit a2a104f3d3)
 2015-11-11 15:37:11 -06:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) bb5dd7f772 YARN-4183. Reverting the patch to fix behaviour change. 
Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)"

This reverts commit 42bc525acb.
 2015-11-11 10:42:52 -08:00
Jason Lowe ee5c20ddef MAPREDUCE-6533. testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken. Contributed by Chang Li 
(cherry picked from commit df68eac825)
 2015-11-11 17:27:03 +00:00
Tsuyoshi Ozawa f6cecbfce5 Updated CHANGES.txt to move HADOOP-12526 to 2.6.3. 2015-11-11 23:21:36 +09:00
Akira Ajisaka f6f128c867 YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas. 
(cherry picked from commit 23d0db551c)
 2015-11-11 16:13:50 +09:00
Xiaoyu Yao f3a075e053 HDFS-9245. Fix findbugs warnings in hdfs-nfs/WriteCtx. Contributed by Mingliang Liu. 
(cherry picked from commit 6e4562b844)
 2015-11-10 16:51:01 -08:00
Xiaoyu Yao 48a494cdc3 HDFS-9234. WebHdfs: getContentSummary() should give quota for storage types. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 41d3f8899d)
 2015-11-10 16:48:06 -08:00
Haohui Mai aaa38581f5 HDFS-9369. Use ctest to run tests for hadoop-hdfs-native-client. Contributed by Haohui Mai. 2015-11-10 14:53:22 -08:00
Wangda Tan 8a8ac50a5b YARN-1510. Make NMClient support change container resources. (Meng Ding via wangda) 
(cherry picked from commit c99925d6dd)
 2015-11-10 13:17:23 -08:00
Vinod Kumar Vavilapalli b742ea7fe6 HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. Fixing bugs in 
the first patch committed. (Karthik Kambatla via vinodkv)
 2015-11-10 12:16:52 -08:00
Colin Patrick Mccabe 7a47989bc9 HADOOP-12560: Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344 (Mingliang Liu via Colin P. McCabe) 
(cherry picked from commit 493e8ae552)
 2015-11-10 10:58:36 -08:00
Zhe Zhang edd4b2d458 HDFS-9364. Unnecessary DNS resolution attempts when creating NameNodeProxies. Contributed by Xiao Chen. 
Change-Id: I9e42f724f27924cf73891425a832de37ce014a1e
 2015-11-10 09:55:39 -08:00
Lei Xu a7243de1a1 HADOOP-12482. Race condition in JMX cache update. (Tony Wu via lei) 
(cherry picked from commit 0eb9c60c5b)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-11-09 23:02:38 -08:00
Walter Su e5420feb09 HDFS-9401. Fix findbugs warnings in BlockRecoveryWorker. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 2fda45b9dc)
 2015-11-10 14:54:04 +08:00
Haohui Mai c91bd3aabb HDFS-2261. AOP unit tests are not getting compiled or run. Contributed by Haohui Mai. 2015-11-09 15:26:01 -08:00
Yongjun Zhang 6bca317157 HDFS-9249. NPE is thrown if an IOException is thrown in NameNode constructor. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 2741a2109b)
 2015-11-09 14:12:20 -08:00
Jian He a4ff03b200 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan 
(cherry picked from commit 8fbea531d7)
 2015-11-09 11:05:12 -08:00
Kihwal Lee ceb062f093 HDFS-9383. TestByteArrayManager#testByteArrayManager fails. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit ef926b2e38)
 2015-11-09 08:57:25 -06:00
Tsuyoshi Ozawa 1c0c77e7f0 MAPREDUCE-5763. Warn message about httpshuffle in NM logs. Contributed by Akira AJISAKA. 
(cherry picked from commit 668e897538)
 2015-11-09 15:26:02 +09:00
Sangjin Lee 7802248c23 HADOOP-12526. there are duplicate dependency definitions in pom's (sjlee) 2015-11-08 17:46:37 -08:00
cnauroth 385dcc4064 HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. Contributed by Mingliang Liu. 
(cherry picked from commit 1ee2db5c41)
 2015-11-07 07:39:45 -08:00
Tsz-Wo Nicholas Sze 9766fc988f HDFS-9398. Make ByteArraryManager log message in one-line format. Contributed by Mingliang Liu 2015-11-07 22:22:36 +08:00
Arpit Agarwal 1e0746e756 HDFS-9379. Make NNThroughputBenchmark support more than 10 datanodes. (Contributed by Mingliang Liu) 2015-11-06 18:59:03 -08:00
Kihwal Lee 481e7248de HDFS-9318. considerLoad factor can be improved. Contributed by Kuhu Shukla. 
(cherry picked from commit bf6aa30a15)
 2015-11-06 14:08:10 -06:00
Yongjun Zhang 41d0d9a32c HDFS-9236. Missing sanity check for block size during block recovery. (Tony Wu via Yongjun Zhang) 
(cherry picked from commit b64242c0d2)
 2015-11-06 11:26:41 -08:00
Arpit Agarwal 33908c6f52 HDFS-6481. DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs. (Contributed by szetszwo) 2015-11-06 10:19:00 -08:00
Lei Xu 47941858af Revert "HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei)" 
This reverts commit 01ae30796d.
 2015-11-06 09:52:21 -08:00
Jason Lowe 836bfdd646 Update CHANGES.txt for commit of HADOOP 12413 to 2.7.3 and 2.6.3 
(cherry picked from commit 74a9a51886)
 2015-11-06 17:18:23 +00:00
cnauroth 75bcc8bcd8 HDFS-9384. TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. Contributed by Chris Nauroth. 
(cherry picked from commit 66c0967310)
 2015-11-05 22:07:34 -08:00
Lei Xu 01ae30796d HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei) 
(cherry picked from commit bff7c90a56)
 2015-11-05 18:36:55 -08:00
Yongjun Zhang 1bb89cbac7 HDFS-9377. Fix findbugs warnings in FSDirSnapshotOp. (Mingliang Liu via Yongjun Zhang) 
(cherry picked from commit 286cc6483f)
 2015-11-05 14:54:29 -08:00
Colin Patrick Mccabe f7e6a5dfb1 Revert "HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe)" 
This reverts commit bb3b2977cd.
 2015-11-05 11:11:27 -08:00
Lei Xu 489c920c9a HDFS-9282. Make data directory count and storage raw capacity related tests FsDataset-agnostic. (Tony Wu via lei) 
(cherry picked from commit 5a1a54c9f5d9a8f7585000fe33ef106e62dbb43a)
 2015-11-05 10:46:46 -08:00
Lei Xu 7a2a17cb5f HDFS-9363. Add fetchReplica to FsDatasetTestUtils to return FsDataset-agnostic replica. (Tony Wu via lei) 
(cherry picked from commit 4976a02841592b61f2d2b40d2aadd5146571322c)
 2015-11-05 10:46:46 -08:00
Colin Patrick Mccabe bb3b2977cd HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe) 
(cherry picked from commit 482e35c55a)
 2015-11-05 10:46:12 -08:00
Haohui Mai aa03030e4a HDFS-9372. Remove dead code in DataStorage.recoverTransitionRead. Contributed by Duo Zhang. 2015-11-05 10:00:18 -08:00
Kihwal Lee 37abd0e33b HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 
(cherry picked from commit ff47f35dee)
 2015-11-05 09:26:53 -06:00
cnauroth 6edd41ac69 HDFS-9378. hadoop-hdfs-client tests do not write logs. Contributed by Chris Nauroth. 
(cherry picked from commit c563401796)
 2015-11-05 06:48:32 -08:00
Xiaoyu Yao 891be39993 HDFS-9360. Storage type usage isn't updated properly after file deletion. Contributed by Ming Ma. 
(cherry picked from commit ea5bb48326)
 2015-11-05 01:40:05 -08:00
cnauroth 81f7e8af22 HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade. 
(cherry picked from commit 0fb1867fd6)
 2015-11-04 10:29:01 -08:00
Lei Xu 8ed1fd2171 HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use. (Tony Wu via lei) 
(cherry picked from commit e2a5441b06)
 2015-11-04 10:28:00 -08:00
Haohui Mai 6d92778191 Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou." 
This reverts commit e7203b6954.
 2015-11-04 10:22:21 -08:00
Lei Xu 3f2be7b18f HDFS-9007. Fix HDFS Balancer to honor upgrade domain policy. (Ming Ma via lei) 2015-11-04 10:21:58 -08:00