Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,239 Commits 326 Branches 371 Tags
Commit Graph

11239 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin Patrick Mccabe
a1f110a145 HDFS-9933. ReverseXML should be capitalized in oiv usage message (cmccabe) 
(cherry picked from commit 79961ecea888e0ee85b7a75e239bb6bb3335eb17)
(cherry picked from commit 710811652c1ac1da9c4fe5f8b0be1bcff7a756f3)
 2016-03-10 13:45:24 -08:00
Colin Patrick Mccabe
56462678f9 HDFS-9934. ReverseXML oiv processor should bail out if the XML file's layoutVersion doesn't match oiv's (cmccabe) 
(cherry picked from commit bd49354c6d6387620b0de2219eab1714ec2d64f8)
(cherry picked from commit c82d1e1187cf4b09c534a15b0dc294751bf2edae)
 2016-03-10 13:44:33 -08:00
Colin Patrick Mccabe
370a956196 HDFS-9927. Document the new OIV ReverseXML processor (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit 500875dfccdb3bb6709767962d1927ddb1cc5514)
(cherry picked from commit b8b580e6b8c737c50f687140cf3aeb9ddf08b89e)
 2016-03-10 13:39:43 -08:00
Li Lu
92e86ff0cb YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. 
This commit amends commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec with a missed test file.

(cherry picked from commit 017d2c127b9cbd75d3e31467172ed832f27ef826)
 2016-03-10 13:06:02 -08:00
Li Lu
8e89bb9d38 YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9) 
(cherry-picked from commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec)
 2016-03-10 10:58:51 -08:00
Allen Wittenauer
a7164e90bf HADOOP-12798. Update changelog and release notes (2016-03-04) (aw) 
(cherry picked from commit 55f73a1cbd45a62774e471b7a8a1e0cc40eecdd4)
(cherry picked from commit 95d30a6ec6648ec3a3ee602d9a8e60fc6001c20e)
 2016-03-09 19:39:31 -08:00
Allen Wittenauer
095b485e48 HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw) 
(cherry picked from commit d759b4bd74ae3d530f8091fa5765664fc850530b)
(cherry picked from commit 140a33df9b8e3ce2dd4b1cb5c765c8e3c4780ee1)
 2016-03-09 19:39:28 -08:00
Colin Patrick Mccabe
56ab796094 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 
(cherry picked from commit 700b0e4019cf483f7532609711812150b8c44742)
(cherry picked from commit 5998b20d63fae09b08bd8bad1aca98551c0ac65a)
 2016-03-09 16:38:15 -08:00
Allen Wittenauer
8b4a8ff1b2 Revert "HADOOP-12366. expose calculated paths (aw)" 
This reverts commit 81a7ad45c9b3f38a4b99e897bb304c362fb1bdf5.
 2016-03-09 09:59:33 -08:00
Arpit Agarwal
0f15eb6a40 HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:52 -08:00
Akira Ajisaka
65769fbf3c HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak. 
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
(cherry picked from commit 0d8ad99e0d551d4426201b1290cfa1da8e7b2ab2)
 2016-03-09 15:33:25 +09:00
Chris Nauroth
a3cd43990c HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 
(cherry picked from commit 89b16d27e26216fc4e5153683105b323c310a0af)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml

(cherry picked from commit 38a031ce68c65956b3dd69b6a93baab1be2beac7)
 2016-03-08 21:23:07 -08:00
Allen Wittenauer
b038f71c67 HADOOP-12904. Update Yetus to 0.2.0 (aw) 2016-03-08 16:45:53 -08:00
Wangda Tan
06088c4c67 YARN-4465. SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled. (Bibin A Chundatt via wangda) 
(cherry picked from commit 0233d4e0ee9947a95c018b1539310fc0bff6c44e)
 2016-03-08 14:31:40 -08:00
Akira Ajisaka
2acd4c3bd2 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit f86850b544dcb34ee3c9336fad584309e886dbed)
(cherry picked from commit 0586386472dddf68826a8d2b6aa647c86d1f18ad)
 2016-03-08 14:30:01 +09:00
Arpit Agarwal
a63f1039f9 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:42 -08:00
Ming Ma
47f884e06a HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma) 
(cherry picked from commit 49eedc7ff02ea61764f416f0e2ddf81370aec5fb)
 2016-03-07 20:32:32 -08:00
Akira Ajisaka
d84d54e26c HDFS-9812. Streamer threads leak if failure happens when closing DFSOutputStream. Contributed by Lin Yiqun. 
(cherry picked from commit 352d299cf8ebe330d24117df98d1e6a64ae38c26)
(cherry picked from commit fe0009a2bd17e26f9e9364ec3f772e9a3f138de8)
 2016-03-08 10:57:56 +09:00
Andrew Wang
352d5a7e88 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang) 
(cherry picked from commit 391da36d93358038c50c15d91543f6c765fa0471)
(cherry picked from commit fed2339e285e84a40514f877703b2712a2305a6f)
 2016-03-07 14:00:15 -08:00
Arpit Agarwal
02949b2151 HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula) 2016-03-07 12:20:32 -08:00
Masatake Iwasaki
22f7730940 HDFS-9865. TestBlockReplacement fails intermittently in trunk (Lin Yiqun via iwasakims) 
(cherry picked from commit d718fc1ee5aee3628e105339ee3ea183b6242409)
 2016-03-08 02:11:54 +09:00
Jason Lowe
0d734cea44 YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger 
(cherry picked from commit 4163e36c2be2f562545aba93c1d47643a9ff4741)
 2016-03-07 15:58:01 +00:00
Jason Lowe
53ec7c9243 YARN-4744. Too many signal to container failure in case of LCE. Contributed by Sidharta Seethana 
(cherry picked from commit 059caf99891943d9587cac19b48e82efbed06b2d)
 2016-03-07 15:48:06 +00:00
Harsh J
5f059e03f5 MAPREDUCE-6648. Add yarn.app.mapreduce.am.log.level to mapred-default.xml (harsh) 2016-03-07 13:13:43 +05:30
Zhihai Xu
1a99d5ab97 YARN-4761. NMs reconnecting with changed capabilities can lead to wrong cluster resource calculations on fair scheduler. Contributed by Sangjin Lee 
(cherry picked from commit e1ccc9622b2f1fbefea1862fa74d1fb56d8eb264)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/TestAbstractYarnScheduler.java
 2016-03-06 20:03:55 -08:00
Robert Kanter
3d8ae9c577 MAPREDUCE-6622. Add capability to set JHS job cache to a task-based limit (rchiang via rkanter) 
(cherry picked from commit 0f72da7e281376f4fcbfbf3fb33f5d7fedcdb1aa)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2016-03-06 19:26:12 -08:00
Chris Nauroth
cb063d5699 HADOOP-12717. NPE when trying to rename a directory in Windows Azure Storage FileSystem. Contributed by Robert Yokota and Gaurav Kanade. 
(cherry picked from commit c50aad0f854b74ede9668e35db314b0a93be81b2)
(cherry picked from commit 2e60387401e1dff3fa36e32b267f2855c2e4ba49)
 2016-03-04 22:58:04 -08:00
Chris Nauroth
d5134dadbc HDFS-9239. DataNode Lifeline Protocol: an alternative protocol for reporting DataNode liveness. Contributed by Chris Nauroth. 
(cherry picked from commit 2759689d7d23001f007cb0dbe2521de90734dd5c)
(cherry picked from commit 592f161e13be9577c2a4e8a53887e71af6ab5c4c)
 2016-03-04 15:30:37 -08:00
Yongjun Zhang
fb6661f3bd HDFS-9889. Update balancer/mover document about HDFS-6133 feature. Contributed by Yongjun Zhang. 
(cherry picked from commit 8e08861a14cb5b6adce338543d7da08e9926ad46)
 2016-03-04 13:28:28 -08:00
Masatake Iwasaki
9d551a3adf HADOOP-12470. In-page TOC of documentation should be automatically generated by doxia macro (iwasakims) 
(cherry picked from commit cbd31328a61252f253aa2bcdb9cad70f7876d231)

 Conflicts:
	hadoop-common-project/hadoop-common/src/site/markdown/CommandsManual.md
	hadoop-common-project/hadoop-common/src/site/markdown/UnixShellGuide.md

(cherry picked from commit 722182fdfbb654be655fbca42f34bba5a05c2f6d)
 2016-03-04 14:13:30 +09:00
Andrew Wang
c6e37f6782 HADOOP-11792. Remove all of the CHANGES.txt files. 2016-03-03 21:03:13 -08:00
Allen Wittenauer
e2ddc9a469 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw) 
(cherry picked from commit 2a867355dfce880bb82257508862ec26bc7f16b9)
(cherry picked from commit f74ecffaa6f01719dbb9a1f5e5704f85715ecf70)
 2016-03-03 20:59:03 -08:00
Allen Wittenauer
a9f041d694 HADOOP-12651. Replace dev-support with wrappers to Yetus (aw) 
(cherry picked from commit 8cecad2d564d89d0f56e98de80a6f9b0bcb39d7a)

 Conflicts:
	dev-support/test-patch.sh
	hadoop-common-project/hadoop-common/pom.xml

(cherry picked from commit b0d3b0c1f86469d1f16a79a2b06f060c3e6f1c26)
 2016-03-03 20:58:56 -08:00
Akira Ajisaka
833d84ab58 HADOOP-12872. Fix formatting in ServiceLevelAuth.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0a9f00af5e11913935ebf426d9da74278dd011af)
(cherry picked from commit 899715a15efb7646d2da5f6bd881c903b9a6e56e)
 2016-03-03 23:33:01 +09:00
Akira Ajisaka
b4710b5052 HADOOP-12871. Fix dead link to NativeLibraries.html in CommandsManual.md. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1c3136cbd8ff5f4eaf9c2c0145975439d0249db3)
(cherry picked from commit 96a0939d5bc26ff42262d9057f9e53c22d090e1d)
 2016-03-03 23:23:27 +09:00
Masatake Iwasaki
55f7ceb0db HDFS-9048. DistCp documentation is out-of-dated (Daisuke Kobayashi via iwasakims) 
(cherry picked from commit 33a412e8a4ab729d588a9576fb7eb90239c6e383)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-03-03 18:58:59 +09:00
Akira Ajisaka
85a62dcb5b HADOOP-12870. Fix typo admininistration in CommandsManual.md. Contributed by John Zhuge. 
(cherry picked from commit eb864d35d6c5f0c0af67032d5f6925aa123273af)
(cherry picked from commit 9e87f59dea25ebb90e7bc3ae640da25c4b8e9a82)
 2016-03-03 18:52:05 +09:00
Masatake Iwasaki
64213b5278 HADOOP-12793. Write a new group mapping service guide (Wei-Chiu Chuang via iwasakims) 
(cherry picked from commit f70e317cccf14185cc24ea3cb57ffc63b00158cc)
 2016-03-03 17:15:09 +09:00
Zhe Zhang
7dfe40a23b HDFS-9886. Configuration properties for hedged read is broken. Contributed by Akira AJISAKA. 2016-03-02 10:27:51 -08:00
Xiaoyu Yao
7b9a2bf278 HDFS-9887. WebHdfs socket timeouts should be configurable. Contributed by Austin Donnelly and Chris Douglas. 
(cherry picked from commit 5abf051249d485313dfffc6aeff6f81c0da1f623)
 2016-03-02 09:25:25 -08:00
Akira Ajisaka
e3d5863677 HDFS-9851. NameNode throws NPE when setPermission is called on a path that does not exist. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 27e0681f28ee896ada163bbbc08fd44d113e7d15)
(cherry picked from commit 463ec6fa8c7d4c925fdd62456b0d2621414ab7d7)
 2016-03-02 14:44:04 +09:00
Akira Ajisaka
b13bd04100 HDFS-9766. TestDataNodeMetrics#testDataNodeTimeSpend fails intermittently. Contributed by Xiao Chen. 
(cherry picked from commit 81fbc40f084eab85750cc7d4cc967d43d70d8333)
(cherry picked from commit e8401417269bc3515918566bb2860e3b70d1d3ed)
 2016-03-02 14:14:52 +09:00
Andrew Wang
90f39b899c HDFS-9881. DistributedFileSystem#getTrashRoot returns incorrect path for encryption zones. 
(cherry picked from commit 4abb2fa687a80d2b76f2751dd31513822601b235)
(cherry picked from commit 81b7b9de27300521b26c8598e3b7fbf88805e505)
 2016-03-01 16:35:46 -08:00
Kihwal Lee
2c8733a19d HDFS-9880. TestDatanodeRegistration fails occasionally. Contributed by Kihwal Lee. 
(cherry picked from commit e76b13c415459e4062c4c9660a16759a11ffb34a)
 2016-03-01 17:02:08 -06:00
Chris Nauroth
f563c53535 HADOOP-12853. Change WASB documentation regarding page blob support. Contributed by Madhumita Chakraborty. 
(cherry picked from commit f98dff329b1f94c9f53022baf0209fc1a7aaf7c2)
(cherry picked from commit bce33b51790b90f0655e36df3a0394f5691f8d6e)
 2016-03-01 13:19:03 -08:00
Jian He
c50f79d838 YARN-4671. There is no need to acquire CS lock when completing a container. Contributed by Meng Ding 2016-03-01 13:15:37 -08:00
Kihwal Lee
cc28118eed HDFS-8791. block ID-based DN storage layout can be very slow for datanode on ext4. Contributed by Chris Trezzo. 
(cherry picked from commit b8dbffbef87c0ee0bee5e17649586fc9f0e1f55b)
 2016-03-01 15:02:26 -06:00
Chris Nauroth
79ef70f861 HDFS-9870. Remove unused imports from DFSUtil. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 2137e8feeb5c5c88d3a80db3a334fd472f299ee4)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit 6659d13f12e697c1ff7b22d0a4ff5519d8adc1aa)
 2016-03-01 11:16:29 -08:00
Akira Ajisaka
aa896c767c HADOOP-12843. Fix findbugs warnings in hadoop-common (branch-2). (aajisaka) 
(cherry picked from commit 67e8489ac6df70e07d530017bb7ddee017e57e5b)
 2016-03-02 00:22:29 +09:00
Chris Nauroth
f1236c5d7c HADOOP-12851. S3AFileSystem Uptake of ProviderUtils.excludeIncompatibleCredentialProviders. Contributed by Larry McCay. 
(cherry picked from commit d251e55415f1fab085159b9eb3b43214d100b6a8)
(cherry picked from commit e402371b6a0854a89e7bd573b04e43fed5e3e9cf)
 2016-02-29 22:00:41 -08:00