Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,341 Commits 326 Branches 371 Tags
Commit Graph

11341 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Lowe
d3dfed3fd0 MAPREDUCE-6684. High contention on scanning of user directory under immediate_done in Job History Server. Contributed by Haibo Chen 
(cherry picked from commit 5ffb54694b52657f3b7de4560474ab740734e1b2)
 2016-05-10 16:06:26 +00:00
Eric Payne
77d147e0ec MAPREDUCE-6678. Allow ShuffleHandler readahead without drop-behind. Contributed by Nathan Roberts. 
(cherry picked from commit cd35b692de88e3afe7f41405da635c3fbd9b4650)
 2016-05-10 16:04:09 +00:00
Vinod Kumar Vavilapalli
e0d6a9632d YARN-4842. Fixed "yarn logs" command to guess (and thus not require) the appOwner argument when viewing another user's logs. Contributed by Ram Venkatesh and Xuan Gong. 
(cherry picked from commit 87f5e351337a905af5215af76c72b9312616cd4f)
 2016-05-09 22:47:58 -07:00
Jian He
007d6d1d57 YARN-4778. Support specifying resources for task containers in SLS. Contributed by Wangda Tan 
(cherry picked from commit 996a210ab0131606639ba87fd5daab14bf05b35f)
 2016-05-09 14:50:00 -07:00
Kihwal Lee
2c782fdb17 HDFS-10372. Fix for failing TestFsDatasetImpl#testCleanShutdownOfVolume. Contributed by Rushabh Shah. 
(cherry picked from commit b9e5a32fa14b727b44118ec7f43fb95de05a7c2c)
 2016-05-09 15:51:42 -05:00
Naganarasimha
3732a1e985 YARN-4926. Change nodelabel rest API invalid reponse status to 400. Contributed by Bibin A Chundatt 
(cherry picked from commit 2750fb900fc9c468570d051cb19e3a379a898c38)
 2016-05-08 23:02:07 +05:30
Yongjun Zhang
5172d0e7b1 YARN-5048. DelegationTokenRenewer#skipTokenRenewal may throw NPE (Jian He via Yongjun Zhang) 
(cherry picked from commit 47c41e7ac7e6b905a58550f8899f629c1cf8b138)
 2016-05-06 22:38:56 -07:00
Andrew Wang
1d563f4d7e HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge. 
(cherry picked from commit 8ef75a702e3b4b8ca7794421c44da7f8d44daa4c)
 2016-05-06 17:23:31 -07:00
Andrew Wang
c328a1ef5e HADOOP-12701. Run checkstyle on test source files. Contributed by John Zhuge. 
(cherry picked from commit e097c9a124dc0b9ae9076994d19663f29d771ef0)
 2016-05-06 17:21:04 -07:00
Jason Lowe
3895058a67 YARN-4747. AHS error 500 due to NPE when container start event is missing. Contributed by Varun Saxena 
(cherry picked from commit b2ed6ae73197990a950ce71ece80c0f23221c384)
 2016-05-06 23:00:25 +00:00
Wangda Tan
b68e6b1d6d getApplicationReport call may raise NPE for removed queues. (Jian He via wangda) 
(cherry picked from commit 23248f63aab74a19dba38d348f2b231c8360770a)
 2016-05-06 15:32:15 -07:00
Jason Lowe
d1aa3e0f89 MAPREDUCE-6689. MapReduce job can infinitely increase number of reducer resource requests. Contributed by Wangda Tan 
(cherry picked from commit c9bb96fa81fc925e33ccc0b02c98cc2d929df120)
 2016-05-06 22:27:24 +00:00
Masatake Iwasaki
4ecbe2e9bf HDFS-2043. TestHFlush failing intermittently. Contributed by Lin Yiqun. 
(cherry picked from commit 2835f146b551f911ea13307e7762759813898757)
 2016-05-06 15:47:51 +09:00
Vinod Kumar Vavilapalli
e9c7a17bc8 MAPREDUCE-6514. Fixed MapReduce ApplicationMaster to properly updated resources ask after ramping down of all reducers avoiding job hangs. Contributed by Varun Saxena and Wangda Tan. 
(cherry picked from commit 8d48266720dcf0e71cfd87fef18b60a53aa1bef9)
 2016-05-05 19:05:44 -07:00
Xiaoyu Yao
35859872b7 HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit dacd1f50feb24ccdf6155b2b7a6126fe21a47ad0)
 2016-05-05 18:15:32 -07:00
Xiaoyu Yao
d18a991817 HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao) 
(cherry picked from commit 4e5e87ddd4a47dbea2b23387782e7cd47dec560e)
 2016-05-05 17:58:41 -07:00
Tsz-Wo Nicholas Sze
b66b85094a HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException 2016-05-05 15:50:50 -07:00
Jian He
a6b24c62ab YARN-4390. Do surgical preemption based on reserved container in CapacityScheduler. Contributed by Wangda Tan 
(cherry picked from commit bb62e0592566b2fcae7136b30972aad2d3ac55b0)
 2016-05-05 12:56:55 -07:00
Jason Lowe
ee86cef2fe YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla 
(cherry picked from commit d0da13229cf692579c8c9db47a93f6c6255392c8)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNode.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/rmnode/RMNodeImpl.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/MockNodes.java
 2016-05-05 14:33:01 +00:00
Varun Vasudev
38a3b86141 YARN-4595. Add support for configurable read-only mounts when launching Docker containers. Contributed by Billie Rinaldi. 
(cherry picked from commit 72b047715c1ae89dff3dfe76c1af91dfe255ed70)
 2016-05-05 13:02:38 +05:30
Robert Kanter
f9d6092108 MAPREDUCE-6675. TestJobImpl.testUnusableNode failed (haibochen via rkanter) 
(cherry picked from commit 9d3fcdfbb314c83ba6185e4ac8de649dad51a279)
 2016-05-04 22:42:34 -07:00
Robert Kanter
cca8e9b90c MAPREDUCE-6677. LocalContainerAllocator doesn't specify resource of the containers allocated (haibochen via rkanter) 
(cherry picked from commit ecce3b7d53ab624c9931273716326c76641ea11d)
 2016-05-04 22:19:42 -07:00
Ming Ma
5b53833171 HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma) 
(cherry picked from commit 1268cf5fbe4458fa75ad0662512d352f9e8d3470)
 2016-05-04 17:04:44 -07:00
Vinod Kumar Vavilapalli
8262ef8318 YARN-4905. Improved "yarn logs" command-line to optionally show log metadata also. Contributed by Xuan Gong. 
(cherry picked from commit 9e37fe3b7a3b5f0a193d228bb5e065f41acd2835)
 2016-05-04 14:17:09 -07:00
Wangda Tan
585299146a YARN-4984. LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak. (Junping Du via wangda) 
(cherry picked from commit 7bd418e48c71590fc8026d69f9b8f8ad42f2aade)
 2016-05-04 11:39:25 -07:00
Junping Du
1ffb0c43d6 YARN-4920. ATS/NM should support a link to dowload/get the logs in text format. Contributed by Xuan Gong. 
(cherry picked from commit 3cf223166d452a0f58f92676837a9edb8ddc1139)
 2016-05-04 10:36:31 -07:00
Jing Zhao
d43d8a1bcd HADOOP-12469. distcp should not ignore the ignoreFailures option. Contributed by Mingliang Liu. 
(cherry picked from commit af942585a108d70e0946f6dd4c465a54d068eabf)
 2016-05-04 10:24:06 -07:00
Arpit Agarwal
cb0a035bd1 HADOOP-13068. Clean up RunJar and related test class. (Contributed by Andras Bokor) 2016-05-04 09:49:51 -07:00
Masatake Iwasaki
2d01ffaf24 HADOOP-12101. Add automatic search of default Configuration variables to TestConfigurationFieldsBase. Contributed by Ray Chiang. 
(cherry picked from commit 355325bcc7111fa4aac801fd23a26422ffabaf7c)
 2016-05-04 15:18:41 +09:00
Rohith Sharma K S
5aad4070b2 YARN-4947. Test timeout is happening for TestRMWebServicesNodes. Contributed by Bibin A Chundatt 
(cherry picked from commit 75e0450593680fb6e57fbef4f4f3af1487023b5d)
 2016-05-04 10:26:25 +05:30
Arpit Agarwal
313b4dbf28 HDFS-9902. Support different values of dfs.datanode.du.reserved per storage type. (Contributed by Brahma Reddy Battula) 2016-05-03 16:52:56 -07:00
Jason Lowe
baac4e7db1 YARN-5003. Add container resource to RM audit log. Contributed by Nathan Roberts 
(cherry picked from commit ed54f5f1ff7862f8216f77d5ea8f9ccea674ccd1)
 2016-05-03 22:16:17 +00:00
Jason Lowe
d8fcf02069 YARN-4834. ProcfsBasedProcessTree doesn't track daemonized processes. Contributed by Nathan Roberts 
(cherry picked from commit c6b48391680c1b81a86aabc3ad4c725bfade6d2e)
 2016-05-03 22:14:50 +00:00
Junping Du
47f67ae447 YARN-4851. Metric improvements for ATS v1.5 storage components. Li Lu via junping_du. 
(cherry picked from commit 06413da72efed9a50e49efaf7110c220c88a7f4a)
 2016-05-03 04:18:01 -07:00
Chris Douglas
a50dc05a60 HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri 
(cherry picked from commit c1cc6ac667e9e1b2ed58f16cb9fa1584ea54f0ac)
 2016-05-02 22:37:36 -07:00
Xiaoyu Yao
ceb9a49d03 HDFS-10344. DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash. Contributed by Xiaoyu Yao. 
(cherry picked from commit 45a753ccf79d334513c7bc8f2b81c89a4697075d)
 2016-05-02 19:37:48 -07:00
Harsh J
89c00da611 HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh) 
(cherry picked from commit 54e612bfb9f877e58f7f153c43cb4147876826d3)
 2016-05-02 17:54:31 -07:00
Andrew Wang
5f46076f2b MAPREDUCE-6537. Include hadoop-pipes examples in the release tarball. Contributed by Kai Sasaki. 
(cherry picked from commit 9e8411d0a630cabbfe7493763c172ff6754e51be)
 2016-05-02 15:35:08 -07:00
Tsz-Wo Nicholas Sze
7e0824faa9 HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou 2016-05-02 11:20:10 -07:00
Colin Patrick Mccabe
b16c376c3b HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 
(cherry picked from commit 2beedead72ee9efb69218aaf587de585158d6a1c)
 2016-05-02 09:43:42 -07:00
Allen Wittenauer
162f5b8178 HADOOP-13012. yetus-wrapper should fail sooner when download fails (Steven Wong via aw) 2016-04-30 12:18:23 -07:00
Kihwal Lee
74938b537d HDFS-10347. Namenode report bad block method doesn't log the bad block or datanode. Contributed by Rushabh Shah. 
(cherry picked from commit 7da540d03eccc2f97950bf47e8b35ce8c889d1e0)
 2016-04-29 15:58:07 -05:00
Chris Nauroth
752a813283 MAPREDUCE-6672. TestTeraSort fails on Windows. Contributed by Tibor Kiss. 
(cherry picked from commit 26ac0f8f0b28758a6404cd7b4b81d79b61d809d9)
 2016-04-29 11:33:41 -07:00
Tsz-Wo Nicholas Sze
fe3c2886be HDFS-10335 Mover$Processor#chooseTarget() always chooses the first matching target storage group. Contributed by Mingliang Liu 2016-04-29 11:24:32 -07:00
Robert Kanter
ac8fb579c6 Remove parent's env vars from child processes 2016-04-29 09:26:09 -07:00
Kihwal Lee
0b9057e1d3 HDFS-10260. TestFsDatasetImpl#testCleanShutdownOfVolume often fails. Contributed by Rushabh Shah. 
(cherry picked from commit af9b000535cc987f66327e2b2bfe08923ba24c13)
 2016-04-29 09:59:58 -05:00
Masatake Iwasaki
ff233dfca0 HADOOP-12378. Fix findbugs warnings in hadoop-tools module. Contributed by Akira AJISAKA. 
(cherry picked from commit ef0870ad038a1b72ea14ce550e34139b81eb901b)
 2016-04-29 20:27:45 +09:00
Varun Vasudev
6561e3b500 YARN-3998. Add support in the NodeManager to re-launch containers. Contributed by Jun Gong. 
(cherry picked from commit 0f25a1bb52bc56661fd020a6ba82df99f8c6ef1f)

 Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/ProtoUtils.java
 2016-04-29 16:22:06 +05:30
Jian He
6ba39a1597 YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe 
(cherry picked from commit 4a8508501bc753858693dacdafba61d604702f71)
 2016-04-28 21:54:30 -07:00
Jian He
a9707dceaf YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe 2016-04-28 21:28:03 -07:00