Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,102 Commits 326 Branches 371 Tags
Commit Graph

11102 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Naganarasimha
b47259caf0 YARN-4926. Change nodelabel rest API invalid reponse status to 400. Contributed by Bibin A Chundatt 
(cherry picked from commit 2750fb900fc9c468570d051cb19e3a379a898c38)
 2016-05-08 23:06:15 +05:30
Yongjun Zhang
5ae5b869aa YARN-5048. DelegationTokenRenewer#skipTokenRenewal may throw NPE (Jian He via Yongjun Zhang) 
(cherry picked from commit 47c41e7ac7e6b905a58550f8899f629c1cf8b138)
 2016-05-06 22:43:44 -07:00
Andrew Wang
8653bcbe67 HDFS-9939. Increase DecompressorStream skip buffer size. Contributed by John Zhuge. 
(cherry picked from commit 8ef75a702e3b4b8ca7794421c44da7f8d44daa4c)
 2016-05-06 17:26:51 -07:00
Jason Lowe
da24fe95f8 YARN-4747. AHS error 500 due to NPE when container start event is missing. Contributed by Varun Saxena 
(cherry picked from commit b2ed6ae73197990a950ce71ece80c0f23221c384)
 2016-05-06 23:00:53 +00:00
Jason Lowe
7fc44311d0 MAPREDUCE-6689. MapReduce job can infinitely increase number of reducer resource requests. Contributed by Wangda Tan 
(cherry picked from commit c9bb96fa81fc925e33ccc0b02c98cc2d929df120)
 2016-05-06 22:28:03 +00:00
Karthik Kambatla
367e757d8d YARN-4947. Test timeout is happening for TestRMWebServicesNodes. Contributed by Bibin A Chundatt 2016-05-06 14:28:24 +05:30
Masatake Iwasaki
c80b47e73f HDFS-2043. TestHFlush failing intermittently. Contributed by Lin Yiqun. 
(cherry picked from commit 2835f146b551f911ea13307e7762759813898757)
 2016-05-06 15:50:48 +09:00
Vinod Kumar Vavilapalli
921562720e MAPREDUCE-6514. Fixed MapReduce ApplicationMaster to properly updated resources ask after ramping down of all reducers avoiding job hangs. Contributed by Varun Saxena and Wangda Tan. 
(cherry picked from commit 8d48266720dcf0e71cfd87fef18b60a53aa1bef9)
 2016-05-05 20:43:55 -07:00
Xiaoyu Yao
59eeee7501 HDFS-10324. Trash directory in an encryption zone should be pre-created with correct permissions. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit dacd1f50feb24ccdf6155b2b7a6126fe21a47ad0)
(cherry picked from commit 35859872b7e339ac0b57f8001c349afe027ee4d2)
 2016-05-05 18:23:00 -07:00
Xiaoyu Yao
4d0b19eec2 HADOOP-13098. Dynamic LogLevel setting page should accept case-insensitive log level string. (Junping Du via xyao) 
(cherry picked from commit 4e5e87ddd4a47dbea2b23387782e7cd47dec560e)
 2016-05-05 18:01:38 -07:00
Tsz-Wo Nicholas Sze
9daa36b8ea HDFS-10346: add org.apache.hadoop.util.StringUtils import. 2016-05-05 15:58:06 -07:00
Tsz-Wo Nicholas Sze
528240f593 HADOOP-13103 Group resolution from LDAP may fail on javax.naming.ServiceUnavailableException 2016-05-05 15:53:51 -07:00
Wangda Tan
3620d0e623 YARN-4984. LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak. (Junping Du via wangda) 
(cherry picked from commit 7bd418e48c71590fc8026d69f9b8f8ad42f2aade)
 2016-05-05 10:08:37 -07:00
Jason Lowe
b452ecf4a0 YARN-4311. Removing nodes from include and exclude lists will not remove them from decommissioned nodes list. Contributed by Kuhu Shukla 
(cherry picked from commit ee86cef2fee992fb773e87c895000ffc2ee788b0)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/resources/yarn-default.xml
 2016-05-05 14:40:35 +00:00
Ming Ma
d6e95ae47b HDFS-10320. Rack failures may result in NN terminate. (Xiao Chen via mingma) 
(cherry picked from commit 1268cf5fbe4458fa75ad0662512d352f9e8d3470)
 2016-05-04 17:07:36 -07:00
Junping Du
22ac37615a YARN-4920. ATS/NM should support a link to dowload/get the logs in text format. Contributed by Xuan Gong. 
(cherry picked from commit 3cf223166d452a0f58f92676837a9edb8ddc1139)
(cherry picked from commit c79dc07dc193904f2586a5d64ea2f4e56d2396b8)
 2016-05-04 09:49:08 -07:00
Masatake Iwasaki
d53121da36 HADOOP-12101. Add automatic search of default Configuration variables to TestConfigurationFieldsBase. Contributed by Ray Chiang. 
(cherry picked from commit 355325bcc7111fa4aac801fd23a26422ffabaf7c)
 2016-05-04 15:22:55 +09:00
Arpit Agarwal
ce94203566 HDFS-9902. Support different values of dfs.datanode.du.reserved per storage type. (Contributed by Brahma Reddy Battula) 2016-05-03 16:53:07 -07:00
Jason Lowe
8013529746 YARN-4834. ProcfsBasedProcessTree doesn't track daemonized processes. Contributed by Nathan Roberts 
(cherry picked from commit c6b48391680c1b81a86aabc3ad4c725bfade6d2e)
 2016-05-03 22:15:31 +00:00
Junping Du
4f1c198881 YARN-4851. Metric improvements for ATS v1.5 storage components. Li Lu via junping_du. 
(cherry picked from commit 06413da72efed9a50e49efaf7110c220c88a7f4a)
(cherry picked from commit 47f67ae44756716588de544d98fb07aae5586ad3)
 2016-05-03 04:59:57 -07:00
Chris Douglas
b5c8bac817 HADOOP-13080. Refresh time in SysInfoWindows is in nanoseconds. Contributed by Inigo Goiri 
(cherry picked from commit c1cc6ac667e9e1b2ed58f16cb9fa1584ea54f0ac)
(cherry picked from commit a50dc05a60487b50b5e8e6f3c99673f18e9aad22)
 2016-05-02 22:38:08 -07:00
rohithsharmaks
9ea567da42 YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks) 
(cherry picked from commit 8c180a13c82ab9d60f595e6942e35d51024dab53)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2016-05-03 10:31:32 +05:30
Xiaoyu Yao
5dfcfb2d2d HDFS-10344. DistributedFileSystem#getTrashRoots should skip encryption zone that does not have .Trash. Contributed by Xiaoyu Yao. 
(cherry picked from commit 45a753ccf79d334513c7bc8f2b81c89a4697075d)
 2016-05-02 19:50:10 -07:00
Xiaoyu Yao
643d2fd3c1 HADOOP-12985. Support MetricsSource interface for DecayRpcScheduler Metrics. Contributed by Xiaoyu Yao. 
(cherry picked from commit 5bd7b592e5fbe4d448fd127c15d29f3121b8a833)
(cherry picked from commit a2a65922dd9783b76d9abacc07ba8cb32e81caea)
 2016-05-02 19:38:03 -07:00
Harsh J
cf6efccebb HDFS-2580. NameNode#main(...) can make use of GenericOptionsParser. Contributed by harsh. (harsh) 
(cherry picked from commit 54e612bfb9f877e58f7f153c43cb4147876826d3)
 2016-05-02 17:53:10 -07:00
Andrew Wang
1207cf1cf6 MAPREDUCE-6537. Include hadoop-pipes examples in the release tarball. Contributed by Kai Sasaki. 
(cherry picked from commit 9e8411d0a630cabbfe7493763c172ff6754e51be)
(cherry picked from commit 5f46076f2bfc646a074a01f7968e3277f7e4abac)
 2016-05-02 15:35:21 -07:00
Tsz-Wo Nicholas Sze
a1ba6eee38 HADOOP-12957. Limit the number of outstanding async calls. Contributed by Xiaobing Zhou 2016-05-02 11:34:59 -07:00
Tsz-Wo Nicholas Sze
bdc45bef64 HDFS-10224. Implement asynchronous rename for DistributedFileSystem. Contributed by Xiaobing Zhou 2016-05-02 11:34:22 -07:00
Lei Xu
5477c31c5c HDFS-3702. Add an option for NOT writing the blocks locally if there is a datanode on the same box as the client. (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 0a152103f19a3e8e1b7f33aeb9dd115ba231d7b7)
(cherry picked from commit 4289cb8b36bcb96510b9e63e3e966e306c6e3893)
 2016-05-02 10:21:59 -07:00
Colin Patrick Mccabe
ef9e7a10e4 HADOOP-13072. WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 
(cherry picked from commit 2beedead72ee9efb69218aaf587de585158d6a1c)
(cherry picked from commit b16c376c3b62ec60aac4041099c4235bdaca815e)
 2016-05-02 09:44:07 -07:00
Robert Kanter
3c3d003402 Remove parent's env vars from child processes 
(cherry picked from commit ac8fb579c6058fec60caf30682f902413d68edf3)
 2016-04-29 15:30:06 -07:00
Kihwal Lee
e9cd88d484 HDFS-10347. Namenode report bad block method doesn't log the bad block or datanode. Contributed by Rushabh Shah. 
(cherry picked from commit 7da540d03eccc2f97950bf47e8b35ce8c889d1e0)
 2016-04-29 15:58:45 -05:00
Chris Nauroth
3222dea8ed MAPREDUCE-6672. TestTeraSort fails on Windows. Contributed by Tibor Kiss. 
(cherry picked from commit 26ac0f8f0b28758a6404cd7b4b81d79b61d809d9)
(cherry picked from commit 752a8132832fd59027df5cb1bbedb9b3b7c54681)
 2016-04-29 11:33:54 -07:00
Tsz-Wo Nicholas Sze
31ed34c982 HDFS-10335 Mover$Processor#chooseTarget() always chooses the first matching target storage group. Contributed by Mingliang Liu 2016-04-29 11:27:14 -07:00
Kihwal Lee
a4db3729be HDFS-10260. TestFsDatasetImpl#testCleanShutdownOfVolume often fails. Contributed by Rushabh Shah. 
(cherry picked from commit af9b000535cc987f66327e2b2bfe08923ba24c13)
 2016-04-29 10:05:58 -05:00
Masatake Iwasaki
50d06acb09 HADOOP-12378. Fix findbugs warnings in hadoop-tools module. Contributed by Akira AJISAKA. 
(cherry picked from commit ef0870ad038a1b72ea14ce550e34139b81eb901b)
 2016-04-29 20:40:47 +09:00
Jian He
5ba79d77fb YARN-5009. NMLeveldbStateStoreService database can grow substantially leading to longer recovery times. Contributed by Jason Lowe 
(cherry picked from commit 4a8508501bc753858693dacdafba61d604702f71)
 2016-04-28 21:54:53 -07:00
Jian He
e62162db46 YARN-5008. LeveldbRMStateStore database can grow substantially leading to long recovery times. Contributed by Jason Lowe 
(cherry picked from commit dd80042c42aadaa347db93028724f69c9aca69c6)
 2016-04-28 21:36:23 -07:00
Andrew Wang
0d4fbf01be HADOOP-13030. Handle special characters in passwords in KMS startup script. Contributed by Xiao Chen. 
(cherry picked from commit 7271e91b791ba277fd2a9b8f870eb9bc4f395566)
 2016-04-27 17:14:00 -07:00
Andrew Wang
bdb0e98483 HDFS-10297. Increase default balance bandwidth and concurrent moves. Contributed by John Zhuge. 2016-04-27 17:03:36 -07:00
Li Lu
76b4ec32e6 YARN-4956. findbug issue on LevelDBCacheTimelineStore. (Zhiyuan Yang via gtcarrera9) 
(cherry picked from commit f16722d2ef31338a57a13e2c8d18c1c62d58bbaf)
 2016-04-27 10:58:50 -07:00
Arpit Agarwal
7cd0177310 HADOOP-5470. RunJar.unJar() should write the last modified time found in the jar entry to the uncompressed file. (Contributed by Andras Bakor) 2016-04-27 10:07:20 -07:00
Kihwal Lee
dd7c9f5b8f HDFS-10330. Add Corrupt Blocks Information in Metasave output. Contributed by Kuhu Shukla. 
(cherry picked from commit e181092b86a8822e0f252b6ffa77baad4f711e77)
 2016-04-27 08:30:29 -05:00
Arpit Agarwal
b39e9efeeb HADOOP-13039. Add documentation for configuration property ipc.maximum.data.length (Contributed by Mingliang Liu) 2016-04-26 20:48:13 -07:00
Masatake Iwasaki
b4ed3285a1 HADOOP-12738. Create unit test to automatically compare Common related classes and core-default.xml. Contributed by Ray Chiang. 
(cherry picked from commit 68b4564e78380a2fac1a9000fb862104d4bc86e5)
 2016-04-27 11:05:56 +09:00
Yongjun Zhang
7ff4fb89ca HDFS-10313. Distcp need to enforce the order of snapshot names passed to -diff. (Lin Yiqun via Yongjun Zhang) 
(cherry picked from commit 959a28dd1216dfac78d05b438828e8503108d963)
(cherry picked from commit 7955b6f66ee670a57ccdeb7b6a9e6af25c0d67c7)
 2016-04-26 16:30:54 -07:00
Jing Zhao
b98b057f45 HDFS-10216. Distcp -diff throws exception when handling relative path. Contributed by Takashi Ohnishi. 
(cherry picked from commit 404f57f328b00a42ec8b952ad08cd7a80207c7f2)
(cherry picked from commit 864baf23aa3df201f81b721852221c6475388295)
 2016-04-26 16:30:46 -07:00
Kihwal Lee
621be60592 HDFS-10329. Bad initialisation of StringBuffer in RequestHedgingProxyProvider. Contributed by Lin Yiqun. 
(cherry picked from commit c6a2430b47692a72c500373d6fc1bce78652675b)
 2016-04-26 11:47:15 -05:00
Kihwal Lee
973c73aa68 HDFS-10318. TestJMXGet hides the real error in case of test failure. Contributed by Andras Bokor. 
(cherry picked from commit 10f0f7851a3255caab775777e8fb6c2781d97062)
 2016-04-25 11:42:17 -05:00
Masatake Iwasaki
e01242edb4 HADOOP-11418. Property "io.compression.codec.lzo.class" does not work with other value besides default. (Yuanbo Liu via iwasakims) 
(cherry picked from commit bec5b4cd8c1fb27a5b707d601b508224a9c107ed)
 2016-04-25 22:50:07 +09:00