Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,252 Commits 326 Branches 371 Tags
Commit Graph

18252 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Yiqun Lin
ea2863f2b5 HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo Goiri. 
(cherry picked from commit b06601acce38ed60b726b99e2830f38a1ee3d2b5)
 2018-04-24 11:27:14 +08:00
Inigo Goiri
5b2427cd73 HDFS-13336. Test cases of TestWriteToReplica failed in windows. Contributed by Xiao Liang. 
(cherry picked from commit df92a17e02fe86279a6f4e413719d0a465b50837)
 2018-04-23 19:12:53 -07:00
Robert Kanter
ea7ad50499 HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter) 
(cherry picked from commit 7ab08a9c37a76edbe02d556fcfb2e637f45afc21)
 2018-04-23 16:25:41 -07:00
Bharat Viswanadham
caf4d5000e HDFS-13356. Balancer:Set default value of minBlockSize to 10mb. Contributed by Bharat Viswanadham 
(cherry picked from commit 9b5375e0c1ee8c634a5accb7415ec27440543a60)
 2018-04-23 16:10:28 -07:00
Chris Douglas
cf272c5179 HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang 
(cherry picked from commit f411de6a79a0a87f03c09366cfe7a7d0726ed932)
 2018-04-23 11:13:52 -07:00
Arpit Agarwal
1f486a0649 HDFS-13433. webhdfs requests can be routed incorrectly in federated cluster. Contributed by Arpit Agarwal. 2018-04-23 10:09:02 -07:00
Sunil G
74f181e5dd YARN-8177. Documentation changes for auto creation of Leaf Queues with node label. Contributed by Suma Shivaprasad. 
(cherry picked from commit 83e5f25d5e28a6975464953dc756a3f464d4be60)
 2018-04-23 13:37:13 +05:30
Sunil G
f53e5e000a YARN-7956. [UI2] Avoid duplicating Components link under Services/<ServiceName>/Components. Contributed by Yesha Vora. 
(cherry picked from commit b6d94fad0811c5b635476d03acea417b277d382b)
 2018-04-23 13:32:54 +05:30
Yiqun Lin
3f72d077ff HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri. 
(cherry picked from commit b6dae26f4490bbd03360b8df19ef00cf843430f3)
 2018-04-21 13:35:04 +08:00
Sangjin Lee
9f648f6e59 HDFS-10183. Prevent race condition during class initialization. Contributed by Pavel Avgustinov. 
(cherry picked from commit f40969a141ec6aff254c41e4185cc61ea9e4e554)
 2018-04-20 20:36:31 -07:00
Eric Yang
5556cf397c YARN-8064. Bugfix for clean up container-executor cmd helper file. 
Contributed by Eric Badger
 2018-04-20 19:12:06 -04:00
Konstantinos Karanasos
18c86a3fb6 YARN-8111. Simplify PlacementConstraints API by removing allocationTagToIntraApp. Contributed by Weiwei Yang. 
(cherry picked from commit 28e2244390c990877dc2ee2733cf9b8d2c75128e)
 2018-04-20 12:25:08 -07:00
Jason Lowe
71b0d52987 YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie 
(cherry picked from commit 766544c0b008da9e78bcea6285b2c478653df75a)
 2018-04-20 13:23:46 -05:00
Sunil G
25b91fa98d YARN-7830. [UI2] Post selecting grid view in Attempt page, attempt info page should also be opened with grid view. Contributed by Gergely Novák. 
(cherry picked from commit 55e4252fc5a30c5b1924208b824e44c4ec5bd140)
 2018-04-20 20:05:47 +05:30
Rohith Sharma K S
71661cec77 YARN-8182. [UI2] Proxy- Clicking on nodes under Nodes HeatMap gives 401 error. Contributed by Sunil G. 
(cherry picked from commit 87e09859f148c369b0ead6cdcf3293c39f2abc4a)
 2018-04-20 19:44:15 +05:30
Rohith Sharma K S
3f5b4276e5 YARN-8189. [UI2] Nodes page column headers are half truncated. Contributed by Sunil G. 
(cherry picked from commit b0753cc2c0536d1eed94ca6c6db2682e7e6aabc4)
 2018-04-20 19:44:06 +05:30
Inigo Goiri
18b6a2a2ee HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar. 
(cherry picked from commit 1134af9ad1daf683204df8f95a8f03d7baaa74d4)
 2018-04-19 14:57:09 -07:00
Sunil G
162db6e826 YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S. 
(cherry picked from commit 7d06806dfdeb3252ac0defe23e8c468eabfa8b5e)
 2018-04-20 00:06:44 +05:30
Sunil G
aa64def228 YARN-5888. [UI2] Improve unit tests for new YARN UI. Contributed by Akhil PB. 
(cherry picked from commit c6d7d3eb059c7539db7d00586e181ec44da13557)
 2018-04-19 22:00:34 +05:30
Xiao Chen
128b09ee43 HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445. 
(cherry picked from commit 650359371175fba416331e73aa03d2a96ccb90e5)
 2018-04-18 22:29:59 -05:00
Weiwei Yang
c3ca10c22a YARN-7734. Fix UT failure TestContainerLogsPage#testContainerLogPageAccess. Contributed by Tao Yang. 
(cherry picked from commit 411993f6e5723c8cba8100bff0269418e46f6367)
 2018-04-18 19:40:34 -07:00
Shashikant Banerjee
a13b3edfd8
HADOOP-15396. Some java source files are executable 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247da77d03c6015de4f18be75924fcb22)
 2018-04-19 08:36:32 +09:00
Bharat Viswanadham
63c1b9d50c HDFS-13464. Fix javadoc in FsVolumeList#handleVolumeFailures. Contributed by Shashikant Banerjee 
(cherry picked from commit bf7694d020ea787c542abc504b55ad1bd1137010)
 2018-04-18 08:24:52 -07:00
Mukul Kumar Singh
94076c4028 HADOOP-15366. Add a helper shutdown routine in HadoopExecutor to ensure clean shutdown. Contributed by Shashikant Banerjee. 2018-04-18 16:30:59 +05:30
Mukul Kumar Singh
a07ba66ee9 HDFS-13426. Fix javadoc in FsDatasetAsyncDiskService#removeVolume. Contributed by Shashikant Banerjee. 2018-04-18 16:30:40 +05:30
Mukul Kumar Singh
d99c8aa898 HDFS-13463. Fix javadoc in FsDatasetImpl#checkAndUpdate. Contributed by Shashikant Banerjee. 2018-04-18 16:30:24 +05:30
Rohith Sharma K S
2e8053600e YARN-8171. [UI2] AM Node link from attempt page should not redirect to new tab. Contributed by Sunil G. 
(cherry picked from commit 034da8fc97f01b8207de945828a28f25cadd77b0)
 2018-04-18 13:40:42 +05:30
Rohith Sharma K S
fa007d986b YARN-8145. yarn rmadmin -getGroups doesn't return updated groups for user. Contributed by Sunil G. 
(cherry picked from commit 241d985467c4a318fa22a3f3007ee1827c94389c)
 2018-04-18 13:40:32 +05:30
Yiqun Lin
213f733604 HADOOP-15391. Add missing css file in hadoop-aws, hadoop-aliyun, hadoop-azure and hadoop-azure-datalake modules. 
(cherry picked from commit 1312f9ae4c3c86501b8f3a2dda8c48e8652e3128)
 2018-04-18 16:06:39 +08:00
Erik Krogen
fb350e8112
HDFS-12828. OIV ReverseXML Processor fails with escaped characters 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 2d9e791a9073de9f65fef5407efd3a42894bc97f)
 2018-04-18 14:40:01 +09:00
Wei Yan
5d50f716e7 HDFS-13466. RBF: Add more router-related information to the UI. 
(cherry picked from commit e4313e7e4725261b652dd7202048ff2373b05e28)
 2018-04-17 15:03:12 -07:00
Inigo Goiri
4be0fa28da HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak. 
(cherry picked from commit c9b33514b8d11db44b5f95b4df43789ed45c47a7)
 2018-04-17 14:20:23 -07:00
Bharat Viswanadham
fc11555caf HDFS-13129. Add a test for DfsAdmin refreshSuperUserGroupsConfiguration. Contributed by Mukul Kumar Singh 
(cherry picked from commit a68b04370f2423f3fa2adb06961fa1818628f2b5)
 2018-04-17 12:41:54 -07:00
Jason Lowe
42aef3b655 YARN-7996. Allow user supplied Docker client configurations with YARN native services. Contributed by Shane Kumpf 
(cherry picked from commit 1d6e43da51aaaab522325bdbe4b51e58934e03f1)
 2018-04-17 11:32:58 -05:00
Inigo Goiri
8f300c9ce1 YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan. 
(cherry picked from commit dd5e18c4aecba56f140c3cc11affc2cb5e61c79d)
 2018-04-17 15:28:13 +05:30
Sunil G
d5adc59017 YARN-8126. Support auto-spawning of admin configured services during bootstrap of RM. Contributed by Rohith Sharma K S. 
(cherry picked from commit 427ad7ecc4afbf2cc4acde22c29a7248c46fb22b)
 2018-04-17 15:25:31 +05:30
Yiqun Lin
1d776f22f9 HDFS-13435. RBF: Improve the error loggings for printing the stack trace. 
(cherry picked from commit c4d3636c21acaeb2b7d56d19cd4996aa25151bd1)
 2018-04-17 11:25:14 +08:00
Virajith Jalaparti
70830d9f9c HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri 2018-04-16 16:06:25 -07:00
Arpit Agarwal
43a2af5569 HDFS-13439. Add test case for read block operation when it is moved. Contributed by Ajay Kumar. 2018-04-16 14:18:41 -07:00
Xiao Chen
805e33b62c HDFS-13056. Expose file-level composite CRCs in HDFS which are comparable across different instances/layouts. Contributed by Dennis Huo. 2018-04-16 11:58:10 -07:00
Eric Yang
2911b5406b YARN-8060. Added default readiness check for service components. 
Contributed by Billie Rinaldi

(cherry picked from 2d0662cfd57bd438421f912dc172e79a15835442)
 2018-04-16 14:53:42 -04:00
Eric Yang
20453488e8 YARN-8032. Added ability to configure failure validity interval for YARN service. 
Contributed by Chandni Singh

(cherry-picked from 647058efc0c7a4442b3e64b4d743df1a589f26bc)
 2018-04-16 14:52:09 -04:00
Eric Yang
148322ca72 YARN-8142. Improve SIGTERM handling for YARN Service Application Master. 
Contributed by Billie Rinaldi

(cherry picked from commit 9031a76d447f0c5eaa392144fd17c5b9812e1b20)
 2018-04-14 12:10:37 -07:00
Wangda Tan
6ee62e6b1c YARN-8138. Add unit test to validate queue priority preemption works under node partition. (Zian Chen via wangda) 
Change-Id: Ibebfab98a714c12c2dc643b6d7b9754a7f813632
 2018-04-14 11:04:49 -07:00
Wangda Tan
0b88683627 YARN-7142. Support placement policy in yarn native services. (Gour Saha via wangda) 
Change-Id: I166c67a7a34430627c17365f60bac75b6da1b434
(cherry picked from commit a0bde7d525911680f9e5fb0a939604865eb8e164)
 2018-04-14 11:01:59 -07:00
Rohith Sharma K S
eb1026dffa YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri. 
(cherry picked from commit 669eb7bdea34f26e9b9b8a2260ae4356791622e7)
 2018-04-14 10:57:02 +05:30
Wei-Chiu Chuang
ca8bb322be HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota. 
(cherry picked from commit e66e287efe2b43e710137a628f03c7df3ebdf498)
 2018-04-13 12:18:49 -07:00
Wangda Tan
994c7d66e0 YARN-8091. Revisit checkUserAccessToQueue RM REST API. (wangda) 
Change-Id: I5fab3fe229c34e967487b7327c7b3c8ddf7cb795
 2018-04-13 10:19:10 -07:00
Wangda Tan
7031a853f4 YARN-8048. Support auto-spawning of admin configured services during bootstrap of RM (Rohith Sharma K S via wangda) 
Change-Id: I2d8d61ccad55e1118009294d7e17822df3cd0fd5
 2018-04-13 10:18:48 -07:00
Sunil G
d98c3ca5fd YARN-8040. [UI2] New YARN UI webapp does not respect current pathname for REST api. Contributed by Sunil G. 2018-04-13 10:18:39 -07:00