Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,935 Commits 326 Branches 371 Tags
Commit Graph

14935 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Chris Douglas
99e82e2c2c HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang 
(cherry picked from commit f411de6a79a0a87f03c09366cfe7a7d0726ed932)
(cherry picked from commit cf272c5179a9cb4b524016c0fca7c69c9eaa92f1)
(cherry picked from commit 956ab12ede390e1eea0a66752e0e6711f47b4b94)
 2018-04-23 11:15:28 -07:00
Yiqun Lin
a975250303 HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri. 
(cherry picked from commit b6dae26f4490bbd03360b8df19ef00cf843430f3)
 2018-04-21 14:53:12 +08:00
Jason Lowe
06f3f453c2 YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie 2018-04-20 13:31:19 -05:00
Sunil G
733248cec7 YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S. 
(cherry picked from commit 7d06806dfdeb3252ac0defe23e8c468eabfa8b5e)
 2018-04-20 12:12:26 +05:30
Inigo Goiri
a3c1735951 HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 1134af9ad1daf683204df8f95a8f03d7baaa74d4)
 2018-04-19 14:58:02 -07:00
Xiao Chen
2444d70a40 HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445. 
(cherry picked from commit 650359371175fba416331e73aa03d2a96ccb90e5)
 2018-04-18 22:43:24 -05:00
Shashikant Banerjee
228869e5f9
HADOOP-15396. Some java source files are executable 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247da77d03c6015de4f18be75924fcb22)
 2018-04-19 08:38:11 +09:00
Brahma Reddy Battula
cbcd16e6b7 HADOOP-15180. branch-2 : daemon processes' sysout overwrites 'ulimit -a' in daemon's out file. Contributed by Ranith Sardar 2018-04-18 23:01:50 +05:30
Erik Krogen
8f341c673f
HDFS-12828. OIV ReverseXML Processor fails with escaped characters 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 2d9e791a9073de9f65fef5407efd3a42894bc97f)
 2018-04-18 14:40:45 +09:00
Inigo Goiri
b4b10786c3 HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak. 2018-04-17 15:18:01 -07:00
Wei Yan
8d720daa49 HDFS-13466. RBF: Add more router-related information to the UI. 
(cherry picked from commit e4313e7e4725261b652dd7202048ff2373b05e28)
 2018-04-17 15:06:48 -07:00
Inigo Goiri
7a2edb588c HADOOP-15394. Backport PowerShell NodeFencer HADOOP-14309 to branch-2. Contributed by Inigo Goiri. 2018-04-17 11:33:09 -07:00
Jason Lowe
5ec195edbc YARN-7189. Container-executor doesn't remove Docker containers that error out early. Contributed by Eric Badger 
(cherry picked from commit 391ac5cdd2f31db2341bb731daee094b9ca309ec)
 2018-04-17 09:53:19 -05:00
Yiqun Lin
88cb461c87 HDFS-13435. RBF: Improve the error loggings for printing the stack trace. 
(cherry picked from commit c4d3636c21acaeb2b7d56d19cd4996aa25151bd1)
 2018-04-17 11:27:30 +08:00
Inigo Goiri
93fc813329 YARN-8164. Fix a potential NPE in AbstractSchedulerPlanFollower. Contributed by lujie. 
(cherry picked from commit f1461b2487d6c7a0b87e3799a8fdb5ade40ad898)
 2018-04-16 17:32:50 -07:00
Inigo Goiri
f37f680a4e YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan. 
(cherry picked from commit dd5e18c4aecba56f140c3cc11affc2cb5e61c79d)
 2018-04-16 17:07:38 -07:00
Virajith Jalaparti
b9dc0e597e HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri 2018-04-16 16:08:36 -07:00
Eric Yang
0731756293 YARN-7810. Update TestDockerContainerRuntime to test with current user credential. 
(contributed by Shane Kumpf)
 2018-04-16 13:39:21 -04:00
Rohith Sharma K S
900e6b435a YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri. 
(cherry picked from commit 669eb7bdea34f26e9b9b8a2260ae4356791622e7)
 2018-04-14 11:15:30 +05:30
Wei-Chiu Chuang
cc2a2a8e06 Revert "YARN-7810. Update TestDockerContainerRuntime to test with current user credential." 
This reverts commit 724bffdb89cd62cc90a1f49c7c5e40998dc1cc0f.
 2018-04-13 10:13:59 -07:00
Yiqun Lin
a7721082dc HDFS-13418. NetworkTopology should be configurable when enable DFSNetworkTopology. Contributed by Tao Jie. 2018-04-13 17:59:35 +08:00
Erik Krogen
31d061e4e8 HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen 
(cherry picked from commit 1a407bc9906306801690bc75ff0f0456f8f265fd)
 2018-04-12 23:39:47 -07:00
Eric E Payne
7393020cb3 YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe 
(cherry picked from commit 18844599aef42f79d2af4500aa2eee472dda95cb)
 2018-04-12 18:19:12 +00:00
Eric E Payne
b0dfb18daa YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe. 
(cherry picked from commit 6bb128dfb893cf0e4aa2d3ecc65440668a1fc8d7)
 2018-04-12 16:38:50 +00:00
Inigo Goiri
20472bdfd2 Revert "HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun." 
This reverts commit 7e692425d538454abf69b07f6e8fd686a1171ac8.
 2018-04-12 08:44:17 -07:00
Akira Ajisaka
f055a53b43
HDFS-7101. Potential null dereference in DFSck#doWork(). Contributed by skrho and Ted Yu. 
(cherry picked from commit 113af12cfb240ea9a7189bb2701693466eb8e993)
 2018-04-12 17:48:45 +09:00
Weiwei Yang
a48deb1552 YARN-7527. Over-allocate node resource in async-scheduling mode of CapacityScheduler. Contributed by Tao Yang. 2018-04-12 10:12:46 +08:00
Akira Ajisaka
be627ccfe3
HDFS-13427. Fix the section titles of transparent encryption document. 
(cherry picked from commit c7cd362afd21add324c3a82c594b133d41cf8d03)
 2018-04-12 10:49:07 +09:00
Eric Yang
724bffdb89 YARN-7810. Update TestDockerContainerRuntime to test with current user credential. 
(contributed by Shane Kumpf)

            Cherry-picked from: 59828be1978ec942dda38774a1d9f741efa96f71
 2018-04-11 20:06:33 -04:00
Inigo Goiri
940d3e6f74 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 18de6f2042b70f9f0d7a2620c60de022768a7b13)
 2018-04-11 12:04:18 -07:00
Inigo Goiri
9af5823dbb HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR. 
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
 2018-04-11 10:42:17 -07:00
Wei Yan
c65ac673a1 HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri. 
(cherry picked from commit 8433f6256c7c67b583466c35f51b1918a4b77b02)
 2018-04-11 09:08:11 -07:00
Weiwei Yang
2b2e2ac5f4 YARN-6629. NPE occurred when container allocation proposal is applied but its resource requests are removed before. Contributed by Tao Yang. 2018-04-11 20:21:05 +08:00
Rohith Sharma K S
754e5189ee MAPREDUCE-7062. Update mapreduce.job.tags description for making use for ATSv2 purpose. Contributed by Charan Hebri. 
(cherry picked from commit 6cc59a09e7330dc893b386d84c8f2aa86c02eace)
 2018-04-11 09:52:17 +05:30
Vrushali C
fe4c7ee94c YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S 
(cherry picked from commit 345e7624d58a058a1bad666bd1e5ce4b346a9056)
 2018-04-11 09:51:42 +05:30
Xiao Chen
95cedc5587 HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah. 2018-04-10 15:46:46 -07:00
Jason Lowe
0fb1457d86 HADOOP-15357. Configuration.getPropsWithPrefix no longer does variable substitution. Contributed by Jim Brennan 2018-04-10 16:59:31 -05:00
Yiqun Lin
ea51ef44fc HDFS-13384. RBF: Improve timeout RPC call mechanism. Contributed by Inigo Goiri. 
(cherry picked from commit e87be8a2a49573897e40bfdf43541e3635e35c98)
 2018-04-10 15:39:46 +08:00
Yiqun Lin
9baebf4b27 HDFS-13410. RBF: Support federation with no subclusters. Contributed by Inigo Goiri. 
(cherry picked from commit a92200f4a6cec57b7080d1cd6e2a20d79d772dd6)
 2018-04-10 14:47:55 +08:00
Sammi Chen
1d78825bf1 HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based uploading mechanism. Contributed by Genmao Yu. 2018-04-10 14:24:31 +08:00
Xiao Chen
f667ef1f65 HADOOP-15375. Branch-2 pre-commit failed to build docker image. 2018-04-09 15:35:10 -07:00
Inigo Goiri
78ec00155e HDFS-13380. RBF: mv/rm fail after the directory exceeded the quota limit. Contributed by Yiqun Lin. 
(cherry picked from commit e9b9f48dad5ebb58ee529f918723089e8356c480)
 2018-04-09 10:11:38 -07:00
Inigo Goiri
7e692425d5 HDFS-13388. RequestHedgingProxyProvider calls multiple configured NNs all the time. Contributed by Jinglun. 
(cherry picked from commit ac32b3576da4cc463dff85118163ccfff02215fc)
 2018-04-09 09:18:42 -07:00
Yiqun Lin
14827da747 HDFS-13402. RBF: Fix java doc for StateStoreFileSystemImpl. Contributed by Yiran Wu. 
(cherry picked from commit 5700556cd65a558f4393e05acb7ea8db3ccd2f36)
 2018-04-08 12:07:44 +08:00
Subru Krishnan
05246b7585 YARN-8110. AMRMProxy recover should catch for all throwable to avoid premature exit. (Botong Huang via Subru). 
(cherry picked from commit 00905efab22edd9857e0a3828c201bf70f03cb96)
 2018-04-06 16:38:28 -07:00
Haibo Chen
b19267259b YARN-8107. Give an informative message when incorrect format is used in ATSv2 filter attributes. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit 024d7c08704e6a5fcc1f53a8f56a44c84c8d5fa0)
(cherry picked from commit b232dcab33c4f3e131b9699119167af8916879c4)
(cherry picked from commit ca105d1c8eb7563fcf7465ed48b8e7ec89eeee59)
 2018-04-06 09:47:25 -07:00
Sean Mackrory
b412958f70 HDFS-13176. WebHdfs file path gets truncated when having semicolon inside. Contributed by Zsolt Venczel. 2018-04-06 07:41:58 -06:00
Wei Yan
689a8252aa HDFS-13353. RBF: TestRouterWebHDFSContractCreate failed. Contributed by Takanobu Asanuma. 
(cherry picked from commit 3121e8c29361cb560df29188e1cd1061a5fc34c4)
 2018-04-05 13:23:07 -07:00
Haibo Chen
a7d8b4d775 YARN-6936. [Atsv2] Retrospect storing entities into sub application table from client perspective. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit f8b8bd53c4797d406bea5b1b0cdb179e209169cc)
(cherry picked from commit 6658018410defe3d7e4ea2a465e68d1cfdde6ada)
(cherry picked from commit 9cb378f5c762f3b26598d3ade448219e5801fa2f)
 2018-04-05 11:45:01 -07:00
Steve Loughran
e5351608ca HADOOP-14651. Update okhttp version to 2.7.5. 
Contributed by Ray Chiang and John Zhuge.
 2018-04-04 15:16:20 +01:00