Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,750 Commits 326 Branches 371 Tags
Commit Graph

8750 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin Patrick Mccabe
6f753da4a9 HDFS-7922. ShortCircuitCache#close is not releasing ScheduledThreadPoolExecutors (Rakesh R via Colin P. McCabe) 
(cherry picked from commit 3c7adaaf3571c91fee80585472d2a81402a53e2b)
 2015-04-01 16:11:44 -07:00
Colin Patrick Mccabe
4b74aa7182 HDFS-8026. Trace FSOutputSummer#writeChecksumChunks rather than DFSOutputStream#writeChunk (cmccabe) 
(cherry picked from commit c94d594a57806dec515e2a2053a1221f8ce48cc4)
 2015-04-01 14:10:25 -07:00
Zhijie Shen
6d0bebc912 YARN-3430. Made headroom data available on app attempt page of RM WebUI. Contributed by Xuan Gong. 
(cherry picked from commit 8366a36ad356e6318b8ce6c5c96e201149f811bd)
 2015-04-01 13:49:00 -07:00
Andrew Wang
b17d8a53fa HDFS-7978. Add LOG.isDebugEnabled() guard for some LOG.debug(..). Contributed by Walter Su. 
(cherry picked from commit ed72daa5df97669906234e8ac9a406d78136b206)
 2015-04-01 12:54:46 -07:00
cnauroth
726024faa5 HADOOP-11787. OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac. Contributed by Kiran Kumar M R. 
(cherry picked from commit a3a96a07faf0c6f6aa3ed33608271c2b1657e437)
 2015-04-01 11:40:16 -07:00
Haohui Mai
2ca2515b33 Add the missing files for HDFS-8009. 2015-04-01 10:58:41 -07:00
Haohui Mai
a5bcfe0d33 HDFS-8009. Signal congestion on the DataNode. Contributed by Haohui Mai. 2015-04-01 10:57:07 -07:00
Wangda Tan
865be70b02 YARN-3425. NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed. (Bibin A Chundatt via wangda) 
(cherry picked from commit 492239424a3ace9868b6154f44a0f18fa5318235)
 2015-04-01 10:15:47 -07:00
Xuan
5e4d457674 YARN-3248. Correct fix version from branch-2.7 to branch-2.8 in the change log. 
(cherry picked from commit 2e79f1c2125517586c165a84e99d3c4d38ca0938)
 2015-04-01 04:33:32 -07:00
Xuan
e26b6e55e9 YARN-3248. Display count of nodes blacklisted by apps in the web UI. 
Contributed by Varun Vasudev

(cherry picked from commit 4728bdfa15809db4b8b235faa286c65de4a48cf6)
 2015-04-01 04:20:37 -07:00
Tsuyoshi Ozawa
80755edb7a YARN-3424. Change logs for ContainerMonitorImpl's resourse monitoring from info to debug. Contributed by Anubhav Dhoot. 
(cherry picked from commit c69ba81497ae4da329ddb34ba712a64a7eec479f)
 2015-04-01 17:44:40 +09:00
Karthik Kambatla
93b29d962d YARN-3428. Debug log resources to be localized for a container. (kasha) 
(cherry picked from commit 2daa478a6420585dc13cea2111580ed5fe347bc1)
 2015-03-31 17:35:11 -07:00
Vinod Kumar Vavilapalli
c980e34bc5 YARN-3304. Addendum patch. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. (Junping Du and Karthik Kambatla via vinodkv) 
(cherry picked from commit 7610925e90155dfe5edce05da31574e4fb81b948)
 2015-03-31 17:28:48 -07:00
Akira Ajisaka
b85bbca745 HDFS-6945. BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed. (aajisaka) 
(cherry picked from commit 18a91fe4df0448d9f7de91602646ecf5a51c52e4)
 2015-04-01 09:08:22 +09:00
Vinod Kumar Vavilapalli
4cf44bef5c Reverted MAPREDUCE-6286, MAPREDUCE-6199, and MAPREDUCE-5875 from branch-2.7. Editing CHANGES.txt to reflect this. 
(cherry picked from commit e428fea73029ea0c3494c71a50c5f6c994888fd2)
 2015-03-31 13:30:22 -07:00
Karthik Kambatla
85c420a4d4 YARN-3412. RM tests should use MockRM where possible. (kasha) 
(cherry picked from commit 79f7f2aabfd7a69722748850f4d3b1ff54af7556)
 2015-03-31 09:22:16 -07:00
Akira Ajisaka
7f6811ad73 HDFS-7671. hdfs user guide should point to the common rack awareness doc. Contributed by Kai Sasaki. 
(cherry picked from commit 859cab2f2273f563fd70e3e616758edef91ccf41)
 2015-04-01 00:26:54 +09:00
yliu
e4cd67e9b0 HDFS-7997. The first non-existing xattr should also throw IOException. (zhouyingchao via yliu) 2015-03-31 21:16:13 +08:00
Tsuyoshi Ozawa
99b8255693 YARN-3258. FairScheduler: Need to add more logging to investigate allocations. Contributed by Anubhav Dhoot. 
(cherry picked from commit b5a22e983832d4843b5df1d07858988e8bbf37e3)
 2015-03-31 17:43:07 +09:00
Arpit Agarwal
312e50f9c4 HDFS-7944. Minor cleanup of BlockPoolManager#getAllNamenodeThreads. (Arpit Agarwal) 2015-03-30 21:24:59 -07:00
Harsh J
32766b6563 HDFS-3918. EditLogTailer shouldn't log WARN when other node is in standby mode. Contributed by Todd Lipcon. 
(cherry picked from commit cce66ba3c9ec293e8ba1afd0eb518c7ca0bbc7c9)
 2015-03-31 08:17:22 +05:30
Arpit Agarwal
abf3ad988d HDFS-7645. Rolling upgrade is restoring blocks from trash multiple times (Contributed by Vinayakumar B and Keisuke Ogiwara) 2015-03-30 15:25:26 -07:00
Vinod Kumar Vavilapalli
defae1d399 Revert "MAPREDUCE-6288. Changed permissions on JobHistory server's done directory so that user's client can load the conf files directly. Contributed by Robert Kanter." 
This reverts commit 5358b83167777a7108b32c9900fb0d01ca0fe961.

(cherry picked from commit cc0a01c50308fe599b4bdd5a80068d6244062e4f)
 2015-03-30 14:52:36 -07:00
Colin Patrick Mccabe
0048ec452b HADOOP-11660. Add support for hardware crc of HDFS checksums on ARM aarch64 architecture (Edward Nevill via Colin P. McCabe) 
(cherry picked from commit d9ac5ee2c4dcd4a108ca892af501618caaea450c)
 2015-03-30 14:03:11 -07:00
Haohui Mai
02fcf622fb Addendum for HDFS-7748. 2015-03-30 13:11:24 -07:00
Wangda Tan
cba4ed1678 YARN-2495. Allow admin specify labels from each NM (Distributed configuration for node label). (Naganarasimha G R via wangda) 
(cherry picked from commit 2a945d24f7de1a7ae6e7bd6636188ce3b55c7f52)
 2015-03-30 12:05:54 -07:00
Haohui Mai
dd5b2dac5a HDFS-7748. Separate ECN flags from the Status in the DataTransferPipelineAck. Contributed by Anu Engineer and Haohui Mai. 2015-03-30 11:59:32 -07:00
Haohui Mai
24d879026d HADOOP-11754. RM fails to start in non-secure mode due to authentication filter failure. Contributed by Haohui Mai. 2015-03-30 11:44:30 -07:00
Haohui Mai
a84fdd5650 HADOOP-11761. Fix findbugs warnings in org.apache.hadoop.security.authentication. Contributed by Li Lu. 2015-03-30 11:09:08 -07:00
Colin Patrick Mccabe
02ed22cd2d HDFS-7261. storageMap is accessed without synchronization in DatanodeDescriptor#updateHeartbeatState() (Brahma Reddy Battula via Colin P. McCabe) 
(cherry picked from commit 1feb9569f366a29ecb43592d71ee21023162c18f)
 2015-03-30 10:53:57 -07:00
Vinod Kumar Vavilapalli
cc130a033a MAPREDUCE-6288. Changed permissions on JobHistory server's done directory so that user's client can load the conf files directly. Contributed by Robert Kanter. 
(cherry picked from commit 5358b83167777a7108b32c9900fb0d01ca0fe961)
 2015-03-30 10:28:28 -07:00
Vinod Kumar Vavilapalli
c5bc48946d YARN-3304. Cleaning up ResourceCalculatorProcessTree APIs for public use and removing inconsistencies in the default values. Contributed by Junping Du and Karthik Kambatla. 
(cherry picked from commit c358368f511963ad8e35f030b9babee541e1bd01)
 2015-03-30 10:11:12 -07:00
Akira Ajisaka
d4bb9b2146 HDFS-8002. Website refers to /trash directory. Contributd by Brahma Reddy Battula. 
(cherry picked from commit e7ea2a8e8f0a7b428ef10552885757b99b59e4dc)
 2015-03-31 00:28:27 +09:00
Kihwal Lee
c4cedfc1d6 HDFS-7742. Favoring decommissioning node for replication can cause a block to stay 
underreplicated for long periods. Contributed by Nathan Roberts.
(cherry picked from commit 04ee18ed48ceef34598f954ff40940abc9fde1d2)
 2015-03-30 10:11:25 -05:00
Harsh J
c58357939f HDFS-4396. Add START_MSG/SHUTDOWN_MSG for ZKFC. Contributed by Liang Xie. 
(cherry picked from commit ae3e8c61ff4c926ef3e71c782433ed9764d21478)
 2015-03-30 15:22:57 +05:30
Vinayakumar B
9f49b3e93d HDFS-7890. Improve information on Top users for metrics in RollingWindowsManager and lower log level (Contributed by J.Andreina) 
(cherry picked from commit 1ed9fb76645ecd195afe0067497dca10a3fb997d)
 2015-03-30 10:04:11 +05:30
Akira Ajisaka
7aded71f3a HDFS-6408. Remove redundant definitions in log4j.properties. Contributed by Abhiraj Butala. 
(cherry picked from commit 232eca944a721c62f37e9012546a7fa814da6e01)
 2015-03-30 11:26:11 +09:00
Akira Ajisaka
a79a38d096 HDFS-6263. Remove DRFA.MaxBackupIndex config from log4j.properties. Contributed by Abhiraj Butala. 
(cherry picked from commit 257c77f895e8e4c3d8748909ebbd3ba7e7f880fc)
 2015-03-30 10:52:45 +09:00
Harsh J
b679dc5a8e HDFS-7501. TransactionsSinceLastCheckpoint can be negative on SBNs. Contributed by Gautam Gopalakrishnan. 
(cherry picked from commit 3d9132d434c39e9b6e142e5cf9fd7a8afa4190a6)
 2015-03-29 00:46:22 +05:30
Ravi Prakash
b1b4951452 YARN-3288. Document and fix indentation in the DockerContainerExecutor code 
(cherry picked from commit e0ccea33c9e12f6930b2867e14b1b37569fed659)
 2015-03-28 08:01:26 -07:00
Harsh J
274db918c3 MAPREDUCE-6291. Correct mapred queue usage command. Contributed by Brahma Reddy Battula. 
(cherry picked from commit f5432cb47dfacaa57faed32a29d00bbeff8a5385)
 2015-03-28 11:58:44 +05:30
Arpit Agarwal
d0bc2eff1a HDFS-7700. Document quota support for storage types. (Contributed by Xiaoyu Yao) 2015-03-27 19:49:33 -07:00
Arun Suresh
dadda2edca HDFS-8004. Use KeyProviderCryptoExtension#warmUpEncryptedKeys when creating an encryption zone. (awang via asuresh) 
(cherry picked from commit e97f8e44af9dffc42c030278425cffe0c9da723b)
 2015-03-27 19:25:32 -07:00
cnauroth
eb7068c2c9 HADOOP-11639. Clean up Windows native code compilation warnings related to Windows Secure Container Executor. Contributed by Remus Rusanu. 
(cherry picked from commit 3836ad6c0b3331cf60286d134157c13985908230)
 2015-03-27 15:03:52 -07:00
Akira Ajisaka
853cc04668 MAPREDUCE-5762. Port MAPREDUCE-3223 (Remove MRv1 config from mapred-default.xml) to branch-2. (aajisaka) 2015-03-28 03:35:03 +09:00
Tsuyoshi Ozawa
f0aa2a7466 MAPREDUCE-6294. Remove an extra parameter described in Javadoc of TockenCache. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 05499b1093ea6ba6a39a1354d67b0a46a2982824)
 2015-03-28 00:08:56 +09:00
Tsuyoshi Ozawa
24b60a7d1a HADOOP-11760. Fix typo of javadoc in DistCp. Contributed by Brahma Reddy Battula. 
(cherry picked from commit e074952bd6bedf58d993bbea690bad08c9a0e6aa)
 2015-03-27 23:16:37 +09:00
Kihwal Lee
577ea08865 HDFS-7990. IBR delete ack should not be delayed. Contributed by Daryn Sharp. 
(cherry picked from commit 60882ab26d49f05cbf0686944af6559f86b3417d)
 2015-03-27 09:06:23 -05:00
cnauroth
36371cddd1 HADOOP-11691. X86 build of libwinutils is broken. Contributed by Kiran Kumar M R. 
(cherry picked from commit af618f23a70508111f490a24d74fc90161cfc079)
 2015-03-26 21:57:13 -07:00
cnauroth
1fd350fa8e HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars, addendum to print warning to stderr. Contributed by Masatake Iwasaki. 2015-03-26 21:48:27 -07:00