Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,065 Commits 326 Branches 371 Tags
Commit Graph

11065 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Benoy Antony
1b263ea490 HADOOP-12929. JWTRedirectAuthenticationHandler must accommodate null expiration time. Contributed by Larry McCay. 
(cherry picked from commit e7ed05e4f5b0421e93f2f2cadc5beda3d28b9911)
 2016-03-21 13:31:55 -07:00
Colin Patrick Mccabe
29872506bc HDFS-9951. Use string constants for XML tags in OfflineImageReconstructor (Lin Yiqun via cmccabe) 
(cherry picked from commit 680716f31e120f4d3ee70b095e4db46c05b891d9)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/OfflineImageReconstructor.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/offlineImageViewer/PBImageXmlWriter.java

(cherry picked from commit 2ce24bf21826fcb81cbb27765807ca9d12bedf6a)
 2016-03-21 11:49:19 -07:00
Andrew Wang
ea44650a64 HDFS-9405. Warmup NameNode EDEK caches in background thread. Contributed by Xiao Chen. 
(cherry picked from commit e3bb38d62567eafe57d16b78deeba1b71c58e41c)
(cherry picked from commit e826d860a7f587fac95e0abf257750d0a40ec65d)
 2016-03-21 11:40:26 -07:00
Haohui Mai
88e7466c4b HADOOP-12819. Migrate TestSaslRPC and related codes to rebase on ProtobufRpcEngine. Contributed by Kai Zheng. 2016-03-20 17:43:10 -07:00
Haohui Mai
57fed702f1 HDFS-7166. SbNN Web UI shows #Under replicated blocks and #pending deletion blocks. Contributed by Wei-Chiu Chuang. 2016-03-20 17:22:09 -07:00
Eric Payne
878e1cfc77 YARN-4686. MiniYARNCluster.start() returns before cluster is completely started. Contributed by Eric Badger. 
(cherry picked from commit 92b7e0d41302b6b110927f99de5c2b4a4a93c5fd)
 2016-03-18 17:19:06 +00:00
Akira Ajisaka
2fe4225051 HDFS-3677. dfs.namenode.edits.dir.required is missing from hdfs-default.xml. Contributed by Mark Yang. 
(cherry picked from commit 414f33126ac178a44146666cc7c00059cfc9cabf)
(cherry picked from commit 41621a994dd3add51ec95a3136070c148b133726)
 2016-03-19 01:11:06 +09:00
Kihwal Lee
242c7f1fee HDFS-9874. Long living DataXceiver threads cause volume shutdown to block. Contributed by Rushabh Shah. 
(cherry picked from commit 63c966a3fbeb675959fc4101e65de9f57aecd17d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
 2016-03-18 10:33:13 -05:00
Colin Patrick Mccabe
73b5a44b0e HDFS-9949. Add a test case to ensure that the DataNode does not regenerate its UUID when a storage directory is cleared (Harsh J via cmccabe) 
(cherry picked from commit dc951e606f40bb779632a8a3e3a46aeccc4a446a)
(cherry picked from commit f69a6c36325f53d5a1b201c8357d94e4139b9a93)
 2016-03-17 10:43:07 -07:00
Junping Du
52ce763a54 YARN-4785. inconsistent value type of the type field for LeafQueueInfo in response of RM REST API. 
(cherry picked from commit ca8106d2dd03458944303d93679daa03b1d82ad5)
(cherry picked from commit 66257613b420ea8e0754f6ea8fc2d6816f0741e0)
 2016-03-17 09:30:43 -07:00
Akira Ajisaka
73ab502271 MAPREDUCE-6645. TestWordStats outputs logs under directories other than target/test-dir. Contributed by Gabor Liptak. 
(cherry picked from commit 80fa70c4e15f16b411cb3691df546499c6a19d4c)
(cherry picked from commit 365d236175ad64c0155926713b74823e1e493bb7)
 2016-03-17 18:09:38 +09:00
Xuan
d21bee170b Revert "YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9)" 
This reverts commit 3a0b69544183f71c4683bc477656473494fc09d0.

(cherry picked from commit a888b5bc533bb91a3394f15a69879be1d7838592)
(cherry picked from commit 398dbde538e0bda2ec8a3b9f21c52526dfa90754)
 2016-03-15 22:12:05 -07:00
Wangda Tan
2d9f42d685 MAPREDUCE-6579. JobStatus#getFailureInfo should not output diagnostic information when the job is running. (Akira AJISAKA via wangda) 
(cherry picked from commit 6529c87551e07e9da1e1b273eff4c6bad6b3e838)
 2016-03-15 17:32:32 -07:00
Li Lu
8640a9c45f YARN-4817. Change Log Level to DEBUG for putDomain call in ATS 1.5. (Xuan Gong via gtcarrera9) 
(cherry-picked from commit 5176a69868484f864c977a6cd13923167082407c)
 2016-03-15 11:49:09 -07:00
Li Lu
0ebc947140 YARN-4814. ATS 1.5 timelineclient impl call flush after every event write. (Xuan Gong via gtcarrera9) 
(cherry picked from commit 3a0b69544183f71c4683bc477656473494fc09d0)
 2016-03-15 11:43:39 -07:00
Kihwal Lee
fce39557d3 HDFS-9904. testCheckpointCancellationDuringUpload occasionally fails. Contributed by Lin Yiqun. 
(cherry picked from commit d4574017845cfa7521e703f80efd404afd09b8c4)
 2016-03-15 10:55:10 -05:00
Tsz-Wo Nicholas Sze
d59c2c4518 HADOOP-12923. Move the test code in ipc.Client to test. 2016-03-14 15:55:20 -07:00
Ravi Prakash
9e804d14c9 HDFS-9953. Download File from UI broken after pagination. Contributed by Brahma Reddy Battula 
(cherry picked from commit 51b7d8935af7487547d46693946b386409edc6c8)
 2016-03-14 14:33:29 -07:00
Chris Nauroth
e6c6f4ddac HDFS-9941. Do not log StandbyException on NN, other minor logging fixes. Contributed by Arpit Agarwal. 
(cherry picked from commit 5644137adad30c84e40d2c4719627b3aabc73628)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockUnderConstructionFeature.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirWriteFileOp.java

(cherry picked from commit dd462bc32f77799827c1bd438ee8fa54dacb20eb)
 2016-03-14 09:55:34 -07:00
Junping Du
4f5b496b8a YARN-4545. Allow YARN distributed shell to use ATS v1.5 APIs. Li Lu via junping_du 
(cherry picked from commit f291d82cd49c04a81380bc45c97c279d791b571c)
(cherry picked from commit 3d5ac829da9946ec0de0309e39f5b7269ee7b0c0)
 2016-03-14 08:34:08 -07:00
Colin Patrick Mccabe
ffa9f2db70 HDFS-9942. Add an HTrace span when refreshing the groups for a username (cmccabe) 
(cherry picked from commit 6e9a582eb1ab040f532fbe95694f5272cda34188)
(cherry picked from commit b67b5b09a7eee9c56b4ff6855b1912c188a82cbd)
 2016-03-11 12:27:32 -08:00
Steve Loughran
a44eec1fde Revert "HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims)" 
This reverts commit 0d3272b54efb9566fedbc83286cec17dbd41e05c.
 2016-03-11 16:59:59 +00:00
Akira Ajisaka
cb97d8fa63 MAPREDUCE-6520. Migrate MR Client test cases part 1. Contributed by Dustin Cote. 
(cherry picked from commit 247a7906092065289ea81139e71badcac6abef1e)
(cherry picked from commit c2e14d1bbb0cf87f76ceba5c958a46e7a4de7215)
 2016-03-11 22:55:16 +09:00
Akira Ajisaka
097a03fb6d Revert "MAPREDUCE-6520. Migrate MR Client test cases part 1." 
This reverts commit 70e232f36e8400b99551ce6f4f4fc48b44e28518.
 2016-03-11 22:55:01 +09:00
Akira Ajisaka
70e232f36e MAPREDUCE-6520. Migrate MR Client test cases part 1. 
(cherry picked from commit ef68b441957c6deb65adae2272d60ac929d00733)
(cherry picked from commit 7d665f0a987c17dcf8a26113c61a70dee196ee3d)
 2016-03-11 22:26:03 +09:00
Masatake Iwasaki
0d3272b54e HADOOP-12672. RPC timeout should not override IPC ping interval (iwasakims) 
(cherry picked from commit 682adc6ba9db3bed94fd4ea3d83761db6abfe695)
 2016-03-11 15:08:23 +09:00
Colin Patrick Mccabe
a1f110a145 HDFS-9933. ReverseXML should be capitalized in oiv usage message (cmccabe) 
(cherry picked from commit 79961ecea888e0ee85b7a75e239bb6bb3335eb17)
(cherry picked from commit 710811652c1ac1da9c4fe5f8b0be1bcff7a756f3)
 2016-03-10 13:45:24 -08:00
Colin Patrick Mccabe
56462678f9 HDFS-9934. ReverseXML oiv processor should bail out if the XML file's layoutVersion doesn't match oiv's (cmccabe) 
(cherry picked from commit bd49354c6d6387620b0de2219eab1714ec2d64f8)
(cherry picked from commit c82d1e1187cf4b09c534a15b0dc294751bf2edae)
 2016-03-10 13:44:33 -08:00
Colin Patrick Mccabe
370a956196 HDFS-9927. Document the new OIV ReverseXML processor (Wei-Chiu Chuang via cmccabe) 
(cherry picked from commit 500875dfccdb3bb6709767962d1927ddb1cc5514)
(cherry picked from commit b8b580e6b8c737c50f687140cf3aeb9ddf08b89e)
 2016-03-10 13:39:43 -08:00
Li Lu
92e86ff0cb YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. 
This commit amends commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec with a missed test file.

(cherry picked from commit 017d2c127b9cbd75d3e31467172ed832f27ef826)
 2016-03-10 13:06:02 -08:00
Li Lu
8e89bb9d38 YARN-4696. Improving EntityGroupFSTimelineStore on exception handling, test setup, and concurrency. (Steve Loughran via gtcarrera9) 
(cherry-picked from commit d49cfb350454c2dfa2f3eb70f79b6d5030ce7bec)
 2016-03-10 10:58:51 -08:00
Allen Wittenauer
a7164e90bf HADOOP-12798. Update changelog and release notes (2016-03-04) (aw) 
(cherry picked from commit 55f73a1cbd45a62774e471b7a8a1e0cc40eecdd4)
(cherry picked from commit 95d30a6ec6648ec3a3ee602d9a8e60fc6001c20e)
 2016-03-09 19:39:31 -08:00
Allen Wittenauer
095b485e48 HADOOP-11791. Update src/site/markdown/releases to include old versions of Hadoop (aw) 
(cherry picked from commit d759b4bd74ae3d530f8091fa5765664fc850530b)
(cherry picked from commit 140a33df9b8e3ce2dd4b1cb5c765c8e3c4780ee1)
 2016-03-09 19:39:28 -08:00
Colin Patrick Mccabe
56ab796094 HDFS-9835. OIV: add ReverseXML processor which reconstructs an fsimage from an XML file (cmccabe) 
(cherry picked from commit 700b0e4019cf483f7532609711812150b8c44742)
(cherry picked from commit 5998b20d63fae09b08bd8bad1aca98551c0ac65a)
 2016-03-09 16:38:15 -08:00
Allen Wittenauer
8b4a8ff1b2 Revert "HADOOP-12366. expose calculated paths (aw)" 
This reverts commit 81a7ad45c9b3f38a4b99e897bb304c362fb1bdf5.
 2016-03-09 09:59:33 -08:00
Arpit Agarwal
0f15eb6a40 HADOOP-12903. IPC Server should allow suppressing exception logging by type, not log 'server too busy' messages. (Arpit Agarwal) 2016-03-08 23:30:52 -08:00
Akira Ajisaka
65769fbf3c HADOOP-12688. Fix deadlinks in Compatibility.md. Contributed by Gabor Liptak. 
(cherry picked from commit 4cbefafcac4e7b20a23b7b416af1a2efe71e1080)
(cherry picked from commit 0d8ad99e0d551d4426201b1290cfa1da8e7b2ab2)
 2016-03-09 15:33:25 +09:00
Chris Nauroth
a3cd43990c HADOOP-12905. Clean up CHANGES.txt RAT exclusions from pom.xml files. Contributed by Chris Nauroth. 
(cherry picked from commit 89b16d27e26216fc4e5153683105b323c310a0af)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/pom.xml
	hadoop-mapreduce-project/pom.xml

(cherry picked from commit 38a031ce68c65956b3dd69b6a93baab1be2beac7)
 2016-03-08 21:23:07 -08:00
Allen Wittenauer
b038f71c67 HADOOP-12904. Update Yetus to 0.2.0 (aw) 2016-03-08 16:45:53 -08:00
Wangda Tan
06088c4c67 YARN-4465. SchedulerUtils#validateRequest for Label check should happen only when nodelabel enabled. (Bibin A Chundatt via wangda) 
(cherry picked from commit 0233d4e0ee9947a95c018b1539310fc0bff6c44e)
 2016-03-08 14:31:40 -08:00
Akira Ajisaka
2acd4c3bd2 HADOOP-12860. Expand section "Data Encryption on HTTP" in SecureMode documentation. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit f86850b544dcb34ee3c9336fad584309e886dbed)
(cherry picked from commit 0586386472dddf68826a8d2b6aa647c86d1f18ad)
 2016-03-08 14:30:01 +09:00
Arpit Agarwal
a63f1039f9 HDFS-9882. Add heartbeatsTotal in Datanode metrics. (Contributed by Hua Liu) 2016-03-07 21:10:42 -08:00
Ming Ma
47f884e06a HADOOP-12789. log classpath of ApplicationClassLoader at INFO level. (Sangjin Lee via mingma) 
(cherry picked from commit 49eedc7ff02ea61764f416f0e2ddf81370aec5fb)
 2016-03-07 20:32:32 -08:00
Akira Ajisaka
d84d54e26c HDFS-9812. Streamer threads leak if failure happens when closing DFSOutputStream. Contributed by Lin Yiqun. 
(cherry picked from commit 352d299cf8ebe330d24117df98d1e6a64ae38c26)
(cherry picked from commit fe0009a2bd17e26f9e9364ec3f772e9a3f138de8)
 2016-03-08 10:57:56 +09:00
Andrew Wang
352d5a7e88 HADOOP-12901. Add warning log when KMSClientProvider cannot create a connection to the KMS server. (Xiao Chen via wang) 
(cherry picked from commit 391da36d93358038c50c15d91543f6c765fa0471)
(cherry picked from commit fed2339e285e84a40514f877703b2712a2305a6f)
 2016-03-07 14:00:15 -08:00
Arpit Agarwal
02949b2151 HDFS-9906. Remove spammy log spew when a datanode is restarted. (Contributed by Brahma Reddy Battula) 2016-03-07 12:20:32 -08:00
Masatake Iwasaki
22f7730940 HDFS-9865. TestBlockReplacement fails intermittently in trunk (Lin Yiqun via iwasakims) 
(cherry picked from commit d718fc1ee5aee3628e105339ee3ea183b6242409)
 2016-03-08 02:11:54 +09:00
Jason Lowe
0d734cea44 YARN-4760. proxy redirect to history server uses wrong URL. Contributed by Eric Badger 
(cherry picked from commit 4163e36c2be2f562545aba93c1d47643a9ff4741)
 2016-03-07 15:58:01 +00:00
Jason Lowe
53ec7c9243 YARN-4744. Too many signal to container failure in case of LCE. Contributed by Sidharta Seethana 
(cherry picked from commit 059caf99891943d9587cac19b48e82efbed06b2d)
 2016-03-07 15:48:06 +00:00
Harsh J
5f059e03f5 MAPREDUCE-6648. Add yarn.app.mapreduce.am.log.level to mapred-default.xml (harsh) 2016-03-07 13:13:43 +05:30