Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
13,657 Commits 326 Branches 371 Tags
Commit Graph

13657 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kihwal Lee
a735916b2c HADOOP-14659. UGI getShortUserName does not need to search the Subject. Contributed by Daryn Sharp. 
(cherry picked from commit b3269f7cc119cbc51b16118b918f345f970804bc)
 2017-07-20 16:15:06 -05:00
Jason Lowe
e76e7b9f0b YARN-6837. Null LocalResource visibility or resource type can crash the nodemanager. Contributed by Jinjiang Ling 
(cherry picked from commit c8df3668ecc37c2d58cad35520a762eaec3c8539)
 2017-07-20 11:06:39 -05:00
Wangda Tan
5070c9ba39 YARN-6775. CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls. (Nathan Roberts via wangda) 
Change-Id: Iaf9bb7e5ed3aa1300abdccf87ae6fcbddbd25e3e
 2017-07-19 15:25:21 -07:00
Daniel Templeton
1d629c95af HADOOP-14666. Tests use assertTrue(....equals(...)) instead of assertEquals() 
(cherry picked from commit c21c26039238f633a0d2df9670f636d026c35649)
 2017-07-19 14:01:10 -07:00
Yongjun Zhang
10a6b6b12c HDFS-12139. HTTPFS liststatus returns incorrect pathSuffix for path of file. Contributed by Yongjun Zhang. 
(cherry picked from commit 3556e36be30211f46ac38899ce11a4d4cac6d635)
 2017-07-19 11:44:35 -07:00
Jitendra Pandey
23b920cd7a HADOOP-14642. wasb: add support for caching Authorization and SASKeys. Contributed by Sivaguru Sankaridurg. 2017-07-19 11:37:36 -07:00
Anu Engineer
e0297ffbc8 HDFS-12158. Secondary Namenode's web interface lack configs for X-FRAME-OPTIONS protection. Contributed by Mukul Kumar Singh. 
(cherry picked from commit 413b23eb04eee24275257ab462133e0818f87449)
 2017-07-19 10:42:28 -07:00
Brahma Reddy Battula
979d37ae21 HDFS-12067. Correct dfsadmin commands usage message to reflects IPC port. Contributed by steven-wugang. 
(cherry picked from commit f8cd55fe33665faf2d1b14df231516fc891118fc)
 2017-07-19 23:22:40 +08:00
Jason Lowe
057631c031 HADOOP-14669. GenericTestUtils.waitFor should use monotonic time. Contributed by Daniel Templeton 
(cherry picked from commit df180259b0cc3660e199e85447c7193bee51751c)
 2017-07-19 09:42:38 -05:00
Rohith Sharma K S
f806e8627b YARN-6819. Application report fails if app rejected due to nodesize. Contributed by Bibin A Chundatt. 
(cherry picked from commit 845c4e52bdd579a24df5dbba7477b0ebf2fa16f1)
 2017-07-19 11:16:17 +05:30
Yufei Gu
d04bb465d2 YARN-6778. In ResourceWeights, weights and setWeights() should be final. (Daniel Templeton via Yufei Gu) 
(cherry picked from commit daaf530fce4b91cf9f568b9b0c5e8b20e6774134)
 2017-07-18 16:40:13 -07:00
Jason Lowe
9b961db569 HADOOP-14637. GenericTestUtils.waitFor needs to check condition again after max wait time. Contributed by Daniel Templeton 
(cherry picked from commit 5aa2bf231f40423865f0054ca27426ceb95ab4ba)
 2017-07-18 16:27:34 -05:00
Sunil G
487b0a3d7f Addendum patch for YARN-5731 
(cherry picked from commit 0b7afc060c2024a882bd1934d0f722bfca731742)
 2017-07-18 13:46:43 +05:30
Jitendra Pandey
b9f2effaf6 HADOOP-14640. Azure: Support affinity for service running on localhost and reuse SPNEGO hadoop.auth cookie for authorization, SASKey and delegation token generation. Contributed by Santhosh G Nayak. 2017-07-17 16:25:05 -07:00
Tsz-Wo Nicholas Sze
02627f8c5f HDFS-12138. Remove redundant 'public' modifiers from BlockCollection. Contributed by Chen Liang 2017-07-17 13:59:52 -07:00
Sunil G
958835a3dc MAPREDUCE-6889. Add Job#close API to shutdown MR client services. Contributed by Rohith Sharma K S. 
(cherry picked from commit fb3b5d33ffb29ee8e1ffbd2eee7a603a5777ebaf)
 2017-07-17 13:36:00 +05:30
Sunil G
9b1abb448d YARN-6714. IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler. Contributed by Tao Yang. 2017-07-17 13:22:04 +05:30
Sunil G
d462e48336 YARN-6280. Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API. Contributed by Lantao Jin. 2017-07-17 12:25:41 +05:30
Brahma Reddy Battula
a33e89931b HDFS-12112. TestBlockManager#testBlockManagerMachinesArray sometimes fails with NPE. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit b778887af59d96f1fac30cae14be1cabbdb74c8b)
 2017-07-15 10:49:11 +08:00
Xiao Chen
5337c2511d HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah. 
(cherry picked from commit aa395c1ec9a170f2da732c6e6114c60412161d40)
 2017-07-14 22:23:07 -07:00
Tsz-Wo Nicholas Sze
bff39ca718 HDFS-12130. Optimizing permission check for getContentSummary. Contributed by Chen Liang 2017-07-14 14:40:11 -07:00
Tsz-Wo Nicholas Sze
d51395363a Revert "HDFS-12130. Optimizing permission check for getContentSummary." to fix commit message. 
This reverts commit 2ba41729abef22f9049fbd6260e8194ac1abf5cc.
 2017-07-14 14:38:27 -07:00
Kihwal Lee
0fd86de128 HDFS-12140. Remove BPOfferService lock contention to get block pool id. Contributed by Daryn Sharp. 
(cherry picked from commit e7d187a1b6a826edd5bd0f708184d48f3674d489)
 2017-07-14 16:12:28 -05:00
Arun Suresh
0101973dbf YARN-5049. Extend NMStateStore to save queued container information. (Konstantinos Karanasos via asuresh) 2017-07-14 13:57:22 -07:00
Kihwal Lee
a47820d72a HDFS-12137. DN dataset lock should be fair. Contributed by Daryn Sharp. 2017-07-14 15:45:26 -05:00
Tsz-Wo Nicholas Sze
2ba41729ab HDFS-12130. Optimizing permission check for getContentSummary. 2017-07-14 13:42:02 -07:00
Jason Lowe
9eb93c6f3f YARN-3260. AM attempt fail to register before RM processes launch event. Contributed by Bibin A Chundatt 
(cherry picked from commit a5ae5ac50e97cf829c41dcf01655cd9bd4d36a00)
 2017-07-14 15:03:48 -05:00
bibinchundatt
af80d10e54 YARN-6759. Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failure. Contributed by Naganarasimha G R 
(cherry picked from commit 75c0220b4494dd4424a0c531e0bf0a763748dc62)
 2017-07-14 14:05:38 +05:30
Yufei Gu
b2a34fe8d6 YARN-6769. Make schedulables without demand less needy in FairSharePolicy#compare. (Yunfan Zhou via Yufei Gu) 
(cherry picked from commit 4a574e9a84f2e997038452b22f2ad2a2d42e8ac8)
 2017-07-13 23:11:27 -07:00
Sunil G
fd6935709f YARN-5731. Preemption calculation is not accurate when reserved containers are present in queue. Contributed by Wangda Tan. 2017-07-14 08:45:17 +05:30
Sunil G
f5cdee6bfd YARN-6792. Incorrect XML convertion in NodeIDsInfo and LabelsToNodesInfo. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit 228ddaa31d812533b862576445494bc2cd8a2884)
 2017-07-14 08:08:32 +05:30
Ravi Prakash
756a068143 MAPREDUCE-6910. MapReduceTrackingUriPlugin can not return the right URI of history server with HTTPS. Contributed by Lantao Jin 
(cherry picked from commit 43f0503286eccbc6bb8ae77584b635bfd0c48e50)
 2017-07-13 16:19:52 -07:00
Jason Lowe
a77fb561ef YARN-6805. NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code. Contributed by Jason Lowe 
(cherry picked from commit ebc048cc055d0f7d1b85bc0b6f56cd15673e837d)
 2017-07-13 17:49:55 -05:00
Jason Lowe
6ce2b0e4d4 YARN-6654. RollingLevelDBTimelineStore backwards incompatible after fst upgrade. Contributed by Jonathan Eagles 
(cherry picked from commit 5f1ee72b0ebf0330417b7c0115083bc851923be4)
 2017-07-13 17:28:49 -05:00
Sunil G
d83e8712f6 YARN-5892. Support user-specific minimum user limit percentage in Capacity Scheduler. Contributed by Eric Payne. 
(cherry picked from commit ca13b224b2feb9c44de861da9cbba8dd2a12cb35)
 2017-07-13 14:50:28 -05:00
Steve Loughran
df69b13b47
HADOOP-14658. branch-2 compilation is broken in hadoop-azure 
Contributed by Sunil G.

Signed-off-by: Steve Loughran <stevel@apache.org>
 2017-07-13 18:25:38 +01:00
Wangda Tan
cbb5f601f1 YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Sunil G via wangda) 
Change-Id: I9b19f69788068be05b3295247cdd7b972f8a573c
(cherry picked from commit c583ab02c730be0a63d974039a78f2dc67dc2db6)
 2017-07-13 10:44:07 -05:00
Masatake Iwasaki
956e83c100 HADOOP-14646. FileContextMainOperationsBaseTest#testListStatusFilterWithSomeMatches never runs. Contributed by Andras Bokor. 
(cherry picked from commit b61ab8573eb2f224481118004f620fe9f18db74b)
 2017-07-13 21:43:10 +09:00
Xiaoyu Yao
af8a227a68 HDFS-11502. Datanode UI should display hostname based on JMX bean instead of window.location.hostname. Contributed by Jeffrey E Rodriguez and Yuanbo Liu. 
(cherry picked from commit e15e2713e1e344b14d63726639d1c83451921515)
 2017-07-12 16:38:56 -07:00
Xuan
edc0aa95f1 YARN-6689. PlacementRule should be configurable. (Jonathan Hung via xgong) 2017-07-12 15:45:51 -07:00
Tsz-Wo Nicholas Sze
b4a108fa9f HDFS-6874. Add GETFILEBLOCKLOCATIONS operation to HttpFS. Contributed by Weiwei Yang 2017-07-12 14:18:22 -07:00
Jason Lowe
401b191a3c YARN-6797. TimelineWriter does not fully consume the POST response. Contributed by Jason Lowe 
(cherry picked from commit 655110393bf90a7dac5d85f831ea225071f5f3c2)
 2017-07-12 15:54:17 -05:00
Junping Du
ea3dba37cd MAPREDUCE-5621. mr-jobhistory-daemon.sh doesn't have to execute mkdir and chown all the time. Contributed by Shinichi Yamashita. 2017-07-12 11:54:26 -07:00
Wangda Tan
f2d440b3b3 YARN-5889. Improve and refactor user-limit calculation in Capacity Scheduler. (Sunil G via wangda) 
(cherry picked from commit 5fb723bb77722d41df6959eee23e1b0cfeb5584e)
 2017-07-12 10:06:02 -05:00
Eric Payne
e6cdf770ca Revert "YARN-2113. Add cross-user preemption within CapacityScheduler's leaf-queue. (Contributed by Sunil G)" 
This reverts commit eda4ac07c1835031aca7e27cc673f1c5913813bb.
Commit eda4ac07c1835031aca7e27cc673f1c5913813bb was a separate patch from trunk rather than a cherry-pick. I will cherryp-ick dependencies and then cherry-pick the trunk commit for YARN-2113.
 2017-07-12 08:56:40 -05:00
Akira Ajisaka
3419381e98
YARN-6809. Fix typo in ResourceManagerHA.md. Contributed by Yeliang Cang. 
(cherry picked from commit b628d0da5196faa5abf4c95dc7e1bb4eb67f6707)
 2017-07-12 19:39:03 +09:00
Steve Loughran
3dfd107070
HADOOP-14581. Restrict setOwner to list of user when security is enabled in wasb. 
Contributed by Varada Hemeswari
(fix for java 7 compilation)
 2017-07-12 11:07:22 +01:00
Steve Loughran
1e69e52603
HADOOP-14581. Restrict setOwner to list of user when security is enabled in wasb. 
Contributed by Varada Hemeswari
 2017-07-12 10:35:59 +01:00
Akira Ajisaka
2653cf4466
HADOOP-14629. Improve exception checking in FileContext related JUnit tests. Contributed by Andras Bokor. 
(cherry picked from commit 9144fd9e9b5d84d71158451428341746a6567152)
 2017-07-12 11:40:48 +09:00
Steve Loughran
41e83b2ca2
HADOOP-14535 wasb: implement high-performance random access and seek of block blobs. 
Contributed by Thomas Marquardt

(cherry picked from commit d670c3a4da7dd80dccf6c6308603bb3bb013b3b0)
 2017-07-11 21:45:24 +01:00