Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,338 Commits 326 Branches 371 Tags
Commit Graph

10338 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kihwal Lee
8726a5e020 HDFS-9396. Total files and directories on jmx and web UI on standby is uninitialized. Contributed by Kihwal Lee. 
(cherry picked from commit a2a104f3d30182953db6690304146f0a582ed241)
 2015-11-11 15:37:11 -06:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
bb5dd7f772 YARN-4183. Reverting the patch to fix behaviour change. 
Revert "YARN-4183. Enabling generic application history forces every job to get a timeline service delegation token (jeagles)"

This reverts commit 42bc525acb78088ed952e92aa49408413937de86.
 2015-11-11 10:42:52 -08:00
Jason Lowe
ee5c20ddef MAPREDUCE-6533. testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken. Contributed by Chang Li 
(cherry picked from commit df68eac825c2b64b2b2dc2193134afaf2a1d9076)
 2015-11-11 17:27:03 +00:00
Tsuyoshi Ozawa
f6cecbfce5 Updated CHANGES.txt to move HADOOP-12526 to 2.6.3. 2015-11-11 23:21:36 +09:00
Akira Ajisaka
f6f128c867 YARN-4241. Fix typo of property name in yarn-default.xml. Contributed by Anthony Rojas. 
(cherry picked from commit 23d0db551cc63def9acbab2473e58fb1c52f85e0)
 2015-11-11 16:13:50 +09:00
Xiaoyu Yao
f3a075e053 HDFS-9245. Fix findbugs warnings in hdfs-nfs/WriteCtx. Contributed by Mingliang Liu. 
(cherry picked from commit 6e4562b844dfbbbdc0074323900eb69ee2a3e9c2)
 2015-11-10 16:51:01 -08:00
Xiaoyu Yao
48a494cdc3 HDFS-9234. WebHdfs: getContentSummary() should give quota for storage types. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 41d3f8899d8b96568f56331eaf598bb356ecdae0)
 2015-11-10 16:48:06 -08:00
Haohui Mai
aaa38581f5 HDFS-9369. Use ctest to run tests for hadoop-hdfs-native-client. Contributed by Haohui Mai. 2015-11-10 14:53:22 -08:00
Wangda Tan
8a8ac50a5b YARN-1510. Make NMClient support change container resources. (Meng Ding via wangda) 
(cherry picked from commit c99925d6dd0235f0d27536f0bebd129e435688fb)
 2015-11-10 13:17:23 -08:00
Vinod Kumar Vavilapalli
b742ea7fe6 HADOOP-12451. Setting HADOOP_HOME explicitly should be allowed. Fixing bugs in 
the first patch committed. (Karthik Kambatla via vinodkv)
 2015-11-10 12:16:52 -08:00
Colin Patrick Mccabe
7a47989bc9 HADOOP-12560: Fix sprintf warnings in {{DomainSocket.c}} introduced by HADOOP-12344 (Mingliang Liu via Colin P. McCabe) 
(cherry picked from commit 493e8ae55278f2446ba251fc39547e61a4115c52)
 2015-11-10 10:58:36 -08:00
Zhe Zhang
edd4b2d458 HDFS-9364. Unnecessary DNS resolution attempts when creating NameNodeProxies. Contributed by Xiao Chen. 
Change-Id: I9e42f724f27924cf73891425a832de37ce014a1e
 2015-11-10 09:55:39 -08:00
Lei Xu
a7243de1a1 HADOOP-12482. Race condition in JMX cache update. (Tony Wu via lei) 
(cherry picked from commit 0eb9c60c5bec79f531da8cb3226d7e8b1d7e6639)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-11-09 23:02:38 -08:00
Walter Su
e5420feb09 HDFS-9401. Fix findbugs warnings in BlockRecoveryWorker. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 2fda45b9dc9c0bf9bb1380134c80836e89d50471)
 2015-11-10 14:54:04 +08:00
Haohui Mai
c91bd3aabb HDFS-2261. AOP unit tests are not getting compiled or run. Contributed by Haohui Mai. 2015-11-09 15:26:01 -08:00
Yongjun Zhang
6bca317157 HDFS-9249. NPE is thrown if an IOException is thrown in NameNode constructor. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 2741a2109b98d0febb463cb318018ecbd3995102)
 2015-11-09 14:12:20 -08:00
Jian He
a4ff03b200 YARN-3840. Resource Manager web ui issue when sorting application by id (with application having id > 9999) Contributed by Mohammad Shahid Khan 
(cherry picked from commit 8fbea531d7f7b665f6f55af54c8ebf330118ff37)
 2015-11-09 11:05:12 -08:00
Kihwal Lee
ceb062f093 HDFS-9383. TestByteArrayManager#testByteArrayManager fails. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit ef926b2e3824475581454c1e17a0d7c94529efde)
 2015-11-09 08:57:25 -06:00
Tsuyoshi Ozawa
1c0c77e7f0 MAPREDUCE-5763. Warn message about httpshuffle in NM logs. Contributed by Akira AJISAKA. 
(cherry picked from commit 668e897538e317d96784f75b4e1f979c72225db7)
 2015-11-09 15:26:02 +09:00
Sangjin Lee
7802248c23 HADOOP-12526. there are duplicate dependency definitions in pom's (sjlee) 2015-11-08 17:46:37 -08:00
cnauroth
385dcc4064 HDFS-9394. branch-2 hadoop-hdfs-client fails during FileSystem ServiceLoader initialization, because HftpFileSystem is missing. Contributed by Mingliang Liu. 
(cherry picked from commit 1ee2db5c41d2e608eb3102d0e13e132448c5ed8f)
 2015-11-07 07:39:45 -08:00
Tsz-Wo Nicholas Sze
9766fc988f HDFS-9398. Make ByteArraryManager log message in one-line format. Contributed by Mingliang Liu 2015-11-07 22:22:36 +08:00
Arpit Agarwal
1e0746e756 HDFS-9379. Make NNThroughputBenchmark support more than 10 datanodes. (Contributed by Mingliang Liu) 2015-11-06 18:59:03 -08:00
Kihwal Lee
481e7248de HDFS-9318. considerLoad factor can be improved. Contributed by Kuhu Shukla. 
(cherry picked from commit bf6aa30a156b3c5cac5469014a5989e0dfdc7256)
 2015-11-06 14:08:10 -06:00
Yongjun Zhang
41d0d9a32c HDFS-9236. Missing sanity check for block size during block recovery. (Tony Wu via Yongjun Zhang) 
(cherry picked from commit b64242c0d2cabd225a8fb7d25fed449d252e4fa1)
 2015-11-06 11:26:41 -08:00
Arpit Agarwal
33908c6f52 HDFS-6481. DatanodeManager#getDatanodeStorageInfos() should check the length of storageIDs. (Contributed by szetszwo) 2015-11-06 10:19:00 -08:00
Lei Xu
47941858af Revert "HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei)" 
This reverts commit 01ae30796d0a120e4317e819533fb52bdae76885.
 2015-11-06 09:52:21 -08:00
Jason Lowe
836bfdd646 Update CHANGES.txt for commit of HADOOP 12413 to 2.7.3 and 2.6.3 
(cherry picked from commit 74a9a51886c4379eefa539912932bfb99d5fd883)
 2015-11-06 17:18:23 +00:00
cnauroth
75bcc8bcd8 HDFS-9384. TestWebHdfsContentLength intermittently hangs and fails due to TCP conversation mismatch between client and server. Contributed by Chris Nauroth. 
(cherry picked from commit 66c096731052fb187dc49f5bcaec8432c4b92d0c)
 2015-11-05 22:07:34 -08:00
Lei Xu
01ae30796d HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei) 
(cherry picked from commit bff7c90a5686de106ca7a866982412c5dfa01632)
 2015-11-05 18:36:55 -08:00
Yongjun Zhang
1bb89cbac7 HDFS-9377. Fix findbugs warnings in FSDirSnapshotOp. (Mingliang Liu via Yongjun Zhang) 
(cherry picked from commit 286cc6483fe458894cdd22ff1d8822c304e0d94f)
 2015-11-05 14:54:29 -08:00
Colin Patrick Mccabe
f7e6a5dfb1 Revert "HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe)" 
This reverts commit bb3b2977cd3c1ccbf8d861cf264a06c249223dc8.
 2015-11-05 11:11:27 -08:00
Lei Xu
489c920c9a HDFS-9282. Make data directory count and storage raw capacity related tests FsDataset-agnostic. (Tony Wu via lei) 
(cherry picked from commit 5a1a54c9f5d9a8f7585000fe33ef106e62dbb43a)
 2015-11-05 10:46:46 -08:00
Lei Xu
7a2a17cb5f HDFS-9363. Add fetchReplica to FsDatasetTestUtils to return FsDataset-agnostic replica. (Tony Wu via lei) 
(cherry picked from commit 4976a02841592b61f2d2b40d2aadd5146571322c)
 2015-11-05 10:46:46 -08:00
Colin Patrick Mccabe
bb3b2977cd HADOOP-11887. Introduce Intel ISA-L erasure coding library for native erasure encoding support (Kai Zheng via Colin P. McCabe) 
(cherry picked from commit 482e35c55a4bec27fa62b29d9e5f125816f1d8bd)
 2015-11-05 10:46:12 -08:00
Haohui Mai
aa03030e4a HDFS-9372. Remove dead code in DataStorage.recoverTransitionRead. Contributed by Duo Zhang. 2015-11-05 10:00:18 -08:00
Kihwal Lee
37abd0e33b HDFS-4937. ReplicationMonitor can infinite-loop in BlockPlacementPolicyDefault#chooseRandom(). Contributed by Kihwal Lee. 
(cherry picked from commit ff47f35deed14ba6463cba76f0e6a6c15abb3eca)
 2015-11-05 09:26:53 -06:00
cnauroth
6edd41ac69 HDFS-9378. hadoop-hdfs-client tests do not write logs. Contributed by Chris Nauroth. 
(cherry picked from commit c563401796c58119d1b42dda55d6916bdab56dfe)
 2015-11-05 06:48:32 -08:00
Xiaoyu Yao
891be39993 HDFS-9360. Storage type usage isn't updated properly after file deletion. Contributed by Ming Ma. 
(cherry picked from commit ea5bb483269b51a349c358b71f84904c76693a66)
 2015-11-05 01:40:05 -08:00
cnauroth
81f7e8af22 HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade. 
(cherry picked from commit 0fb1867fd62b5df664ad66386d6067db8fbf2317)
 2015-11-04 10:29:01 -08:00
Lei Xu
8ed1fd2171 HDFS-9331. Modify TestNameNodeMXBean#testNameNodeMXBeanInfo() to account for filesystem entirely allocated for DFS use. (Tony Wu via lei) 
(cherry picked from commit e2a5441b062fd0758138079d24a2740fc5e5e350)
 2015-11-04 10:28:00 -08:00
Haohui Mai
6d92778191 Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. Contributed by Xiaobing Zhou." 
This reverts commit e7203b69548a7926a345e2b18f0a227f7f8ca52c.
 2015-11-04 10:22:21 -08:00
Lei Xu
3f2be7b18f HDFS-9007. Fix HDFS Balancer to honor upgrade domain policy. (Ming Ma via lei) 2015-11-04 10:21:58 -08:00
Kihwal Lee
c8ffea3db7 fix up CHANGES.txt 2015-11-04 12:15:58 -06:00
Haohui Mai
b61aa716e8 HDFS-9357. NN UI renders icons of decommissioned DN incorrectly. Contributed by Surendra Singh Lilhore. 2015-11-04 09:17:01 -08:00
Jason Lowe
b9389ac5b5 HADOOP-12296. when setnetgrent returns 0 in linux, exception should be thrown. Contributed by Chang Li 
(cherry picked from commit b9d25c3ee2d20166d6a786c5a16cc001e249f61c)
 2015-11-04 16:35:12 +00:00
Jason Lowe
8334d86472 Add 2.7.3 release to CHANGES.txt 
(cherry picked from commit 0383a3973b3b734fb23c331a2256dc92cff05365)
 2015-11-04 16:27:28 +00:00
Yongjun Zhang
0b61ccaeca HDFS-9351. checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs(). (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 194251c85250fcbe80a6ffee88b2cd4689334be3)
 2015-11-03 17:27:14 -08:00
Zhe Zhang
4f29f5d192 HDFS-9289. Make DataStreamer#block thread safe and verify genStamp in commitBlock. Contributed by Chang Li. 
Change-Id: I0591b1f9c6a0a8b368408b195151de2e0aa440c4
 2015-11-03 14:23:02 -08:00
cnauroth
246ab44b5e HDFS-9362. TestAuditLogger#testAuditLoggerWithCallContext assumes Unix line endings, fails on Windows. Contributed by Chris Nauroth. 
(cherry picked from commit 7e2829662b4c4bf33ebaf2fa09312d0bed3d6f92)
 2015-11-03 11:55:07 -08:00