Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,478 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

7478 Commits

Author SHA1 Message Date
Vinod Kumar Vavilapalli 8a09fdccb3 YARN-2685. Fixed a bug in CommonNodeLabelsManager that caused wrong resource tracking per label when a host runs multiple node-managers. Contributed by Wangda Tan. 
(cherry picked from commit b3056c266a)
 2014-10-15 18:49:06 -07:00
Vinod Kumar Vavilapalli fe80fd5e88 YARN-2496. Enhanced Capacity Scheduler to have basic support for allocating resources based on node-labels. Contributed by Wangda Tan. 
YARN-2500. Ehnaced ResourceManager to support schedulers allocating resources based on node-labels. Contributed by Wangda Tan.

(cherry picked from commit f2ea555ac6)
 2014-10-15 18:35:34 -07:00
Ravi Prakash 7b53ab7b14 HADOOP-11181. GraphiteSink emits wrong timestamps (Sascha Coenen via raviprak) 
(cherry picked from commit 466f08792f)
 2014-10-15 15:53:47 -07:00
Jian He bd45dba807 YARN-2312. Deprecated old ContainerId#getId API and updated MapReduce to use ContainerId#getContainerId instead. Contributed by Tsuyoshi OZAWA 
(cherry picked from commit f93d2ea27e)
 2014-10-15 15:31:57 -07:00
Jason Lowe ec38eec165 MAPREDUCE-5970. Provide a boolean switch to enable MR-AM profiling. Contributed by Gera Shegalov 
(cherry picked from commit f19771a24c)
 2014-10-15 17:52:12 +00:00
Jing Zhao 439560dcf2 HDFS-7185. The active NameNode will not accept an fsimage sent from the standby during rolling upgrade. Contributed by Jing Zhao. 2014-10-15 10:28:40 -07:00
Jason Lowe 9203ea7ea9 MAPREDUCE-5873. Shuffle bandwidth computation includes time spent waiting for maps. Contributed by Siqi Li 
(cherry picked from commit b9edad6403)
 2014-10-15 15:59:56 +00:00
Zhijie Shen eb055eadd7 YARN-2656. Made RM web services authentication filter support proxy user. Contributed by Varun Vasudev and Zhijie Shen. 
(cherry picked from commit 1220bb72d4)
 2014-10-14 21:58:12 -07:00
Zhijie Shen e71fa82ee5 HADOOP-11181. Generalized o.a.h.s.t.d.DelegationTokenManager to handle all sub-classes of AbstractDelegationTokenIdentifier. Contributed by Zhijie Shen. 
(cherry picked from commit cdce88376a)
 2014-10-14 11:39:06 -07:00
Jing Zhao 3d2d501abb HDFS-7228. Add an SSD policy into the default BlockStoragePolicySuite. Contributed by Jing Zhao. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSOutputStream.java
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockStoragePolicySuite.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestBlockStoragePolicy.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/mover/TestStorageMover.java
 2014-10-14 10:43:12 -07:00
Haohui Mai 21fa0f6c43 HADOOP-11198. Fix typo in javadoc for FileSystem#listStatus(). Contributed by Li Lu. 2014-10-13 20:44:23 -07:00
Tsz-Wo Nicholas Sze 20fc34edac HDFS-7237. The command "hdfs namenode -rollingUpgrade" throws ArrayIndexOutOfBoundsException. 2014-10-13 18:37:34 -07:00
Aaron T. Myers 834533fdfc HADOOP-11176. KMSClientProvider authentication fails when both currentUgi and loginUgi are a proxied user. Contributed by Arun Suresh. 
(cherry picked from commit 0e57aa3bf6)
(cherry picked from commit f3132eee10)
 2014-10-13 18:10:40 -07:00
Karthik Kambatla e6102b1828 YARN-2566. DefaultContainerExecutor should pick a working directory randomly. (Zhihai Xu via kasha) 
(cherry picked from commit cc93e7e683)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/DefaultContainerExecutor.java
 2014-10-13 16:42:47 -07:00
Jian He da3e84beb9 Missing Changes.txt for YARN-2308 
(cherry picked from commit 178bc505da)
 2014-10-13 14:21:01 -07:00
Jian He 29496c9be2 YARN-2308. Changed CapacityScheduler to explicitly throw exception if the queue 
to which the apps were submitted is changed across RM restart. Contributed by Craig Welch & Chang Li
(cherry picked from commit f9680d9a16)
 2014-10-13 14:16:57 -07:00
Jason Lowe 9d73c1b15f YARN-2377. Localization exception stack traces are not passed as diagnostic info. Contributed by Gera Shegalov 
(cherry picked from commit a56ea01002)
 2014-10-13 18:34:28 +00:00
Zhijie Shen 6da637ec12 YARN-2651. Spun off LogRollingInterval from LogAggregationContext. Contributed by Xuan Gong. 
(cherry picked from commit 4aed2d8e91)
 2014-10-13 10:56:22 -07:00
Haohui Mai 4fb157655a HDFS-6544. Broken Link for GFS in package.html. Contributed by Suraj Nayak M. 2014-10-13 10:35:48 -07:00
Jing Zhao 369ef7c4b7 HDFS-7236. Fix TestOpenFilesWithSnapshot#testOpenFilesWithMultipleSnapshots. Contributed by Yongjun Zhang. 2014-10-13 10:30:44 -07:00
Jason Lowe 034fcaa540 MAPREDUCE-6115. TestPipeApplication#testSubmitter fails in trunk. Contributed by Binglin Chang 
(cherry picked from commit 793dbf2465)
 2014-10-13 16:06:28 +00:00
Jason Lowe eb5faa161a YARN-2667. Fix the release audit warning caused by hadoop-yarn-registry. Contributed by Yi Liu 
(cherry picked from commit 344a10ad5e)
 2014-10-13 15:46:14 +00:00
Jason Lowe 5dbbabe85f MAPREDUCE-6125. TestContainerLauncherImpl sometimes fails. Contributed by Mit Desai 
(cherry picked from commit bbe80cdc7b)
 2014-10-13 15:12:05 +00:00
Steve Loughran 752f724d52 YARN-2668 yarn-registry JAR won't link against ZK 3.4.5. (stevel) 2014-10-11 18:32:47 -07:00
Haohui Mai edf2497df7 HADOOP-11193. Fix uninitialized variables in NativeIO.c. Contributed by Xiaoyu Yao. 2014-10-10 23:04:19 -07:00
Uma Maheswara Rao G 157f86fca5 HADOOP-11133. Should trim the content of keystore password file for JavaKeyStoreProvider (Yi Liu via umamahesh) 
(cherry picked from commit 8d7c54967d)
 2014-10-10 23:04:12 -07:00
Vinod Kumar Vavilapalli 8dacf89b3e YARN-2501. Enhanced AMRMClient library to support requests against node labels. Contributed by Wangda Tan. 
(cherry picked from commit a5ec3d0809)
 2014-10-10 19:59:30 -07:00
Vinod Kumar Vavilapalli bb6c79f76c YARN-2494. Added NodeLabels Manager internal API and implementation. Contributed by Wangda Tan. 
(cherry picked from commit db7f165319)
 2014-10-10 11:46:10 -07:00
Zhijie Shen 16d7144337 YARN-2583. Modified AggregatedLogDeletionService to be able to delete rolling aggregated logs. Contributed by Xuan Gong. 
(cherry picked from commit cb81bac002)
 2014-10-10 00:18:24 -07:00
cnauroth 281041a57e YARN-2662. TestCgroupsLCEResourcesHandler leaks file descriptors. Contributed by Chris Nauroth. 
(cherry picked from commit d3afd730ac)
(cherry picked from commit b81641a310)
 2014-10-09 22:49:00 -07:00
cnauroth 308e336853 MAPREDUCE-6123. TestCombineFileInputFormat incorrectly starts 2 MiniDFSCluster instances. Contributed by Chris Nauroth. 
(cherry picked from commit 777877d079)
(cherry picked from commit f6278cbac5)
 2014-10-09 22:40:34 -07:00
cnauroth 4573bbe33d MAPREDUCE-6122. Fix CHANGES.txt. 
(cherry picked from commit 2f0166db56)
(cherry picked from commit 61be28f501)
 2014-10-09 22:33:54 -07:00
cnauroth 3fe4e0d3df MAPREDUCE-6122. TestLineRecordReader may fail due to test data files checked out of git with incorrect line endings. Contributed by Chris Nauroth. 
(cherry picked from commit 684170d5ef)
(cherry picked from commit 85a2b90740)
 2014-10-09 22:30:25 -07:00
Zhijie Shen ce704583a7 YARN-2671. Fix the Jira number in the change log. 
(cherry picked from commit 5b12df6587)
 2014-10-09 21:00:38 -07:00
Zhijie Shen 647874206c YARN-2617. Fixed ApplicationSubmissionContext to still set resource for backward compatibility. Contributed by Wangda Tan. 
(cherry picked from commit e532ed8faa)
 2014-10-09 18:01:13 -07:00
Colin Patrick Mccabe 14080ea3d2 HADOOP-11184. Update Hadoop's lz4 to r123 (cmccabe) 
(cherry picked from commit d8d628d1e0)
(cherry picked from commit 8addbe2b8e)
 2014-10-09 17:12:48 -07:00
Vinod Kumar Vavilapalli 967c758373 YARN-2544. Added admin-API objects for using node-labels. Contributed by Wangda Tan. 
(cherry picked from commit 596702a025)
 2014-10-09 15:47:51 -07:00
Andrew Wang 2ff182c890 HADOOP-11174. Delegation token for KMS should only be got once if it already exists. (Yi Liu via wang) 
(cherry picked from commit 8d94114495)
 2014-10-09 13:21:34 -07:00
Zhijie Shen a4522e90f6 YARN-2629. Made the distributed shell use the domain-based timeline ACLs. Contributed by Zhijie Shen. 
(cherry picked from commit 1d4612f5ad)
 2014-10-09 13:03:03 -07:00
Andrew Wang e7b215dfa7 HADOOP-11178. Fix findbugs exclude file. (Arun Suresh via wang) 
(cherry picked from commit d7b647f0ee)
 2014-10-09 11:59:15 -07:00
cnauroth 754718aed5 HDFS-7195. Update user doc of secure mode about Datanodes don't require root or jsvc. Contributed by Chris Nauroth. 
(cherry picked from commit 4e544c84e9)
 2014-10-09 11:57:00 -07:00
Mayank Bansal cf0ad82c5a YARN-2598 GHS should show N/A instead of null for the inaccessible information (Zhijie Shen via mayank) 2014-10-09 11:39:25 -07:00
Vinod Kumar Vavilapalli ad7baad21e YARN-2493. Added user-APIs for using node-labels. Contributed by Wangda Tan. 
(cherry picked from commit 180afa2f86)
 2014-10-09 11:27:49 -07:00
cnauroth cf7eaf28e9 HADOOP-11175. Fix several issues of hadoop security configuration in user doc. Contributed by Yi Liu. 
(cherry picked from commit 1123a06e36)
(cherry picked from commit 5af4c021cc)
 2014-10-09 11:12:58 -07:00
Kihwal Lee 0280e9aee0 HDFS-7217. Better batching of IBRs. Contributed by Kihwal Lee. 
(cherry picked from commit db71bb54bc)
 2014-10-09 12:11:42 -05:00
Aaron T. Myers f86c9c6c71 HADOOP-11161. Expose close method in KeyProvider to give clients of Provider implementations a hook to release resources. Contribued by Arun Suresh. 
(cherry picked from commit d9556e873ef4d3e68c4f0c991f856d1faa747f07)
(cherry picked from commit 3a2565c7be80cf6e9cdfec0f5460ed8ed2252768)
 2014-10-08 18:00:37 -07:00
Zhijie Shen ab448565c9 HADOOP-11179. Java untar should handle the case that the file entry comes without its parent directory entry. Contributed by Craig Welch. 
(cherry picked from commit a169051931)
 2014-10-08 15:39:30 -07:00
Colin Patrick Mccabe 204148f0d4 HADOOP-10404. Some accesses to DomainSocketWatcher#closed are not protected by the lock (cmccabe) 2014-10-08 13:58:28 -07:00
Kihwal Lee 522b6505f4 HDFS-7203. Concurrent appending to the same file can cause data 
corruption. Contributed by Kihwal Lee.
(cherry picked from commit 853cb704ed)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2014-10-08 15:10:03 -05:00
Steve Loughran 088ae9c5bf YARN-913 service registry: YARN-2652 add hadoop-yarn-registry package under hadoop-yarn 2014-10-08 12:54:37 -07:00