Commit Graph

17843 Commits

Author SHA1 Message Date
Inigo Goiri 71e52c936d HDFS-13434. RBF: Fix dead links in RBF document. Contributed by Chetna Chaudhari.
(cherry picked from commit f469628bba)
2018-04-27 15:16:03 -07:00
Wangda Tan c9f7209662 YARN-8210. AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs. (Suma Shivaprasad via wangda)
Change-Id: I70edd6e301fd5e78d479e1882aedc9332a0827aa
(cherry picked from commit b1833d9ba2)
2018-04-27 13:18:35 -07:00
Rohith Sharma K S 8d3e6f99c1 YARN-8221. RMWebServices also need to honor yarn.resourcemanager.display.per-user-apps. Contributed by Sunil G.
(cherry picked from commit ef3ecc308d)
2018-04-27 22:59:48 +05:30
Sunil G f1f3cbb4df YARN-8004. Add unit tests for inter queue preemption for dominant resource calculator. Contributed by Zian Chen.
(cherry picked from commit 71220d218d)
2018-04-27 10:43:24 +05:30
Sunil G 1d5bcb8ace YARN-8215. ATS v2 returns invalid YARN_CONTAINER_ALLOCATED_HOST_HTTP_ADDRESS from NM. Contributed by Rohith Sharma K S.
(cherry picked from commit 7fc09c4f72)
2018-04-27 10:34:52 +05:30
Sunil G 62921db4b9 YARN-8205. Application State is not updated to ATS if AM launching is delayed. Contributed by Rohith Sharma K S.
(cherry picked from commit 1634de0fc1)
2018-04-27 10:28:41 +05:30
Yiqun Lin 1c65529dc3 HDFS-13499. RBF: Show disabled name services in the UI. Contributed by Inigo Goiri.
(cherry picked from commit 0a293de00d)
2018-04-27 10:40:13 +08:00
Inigo Goiri a71d184f4f HDFS-13326. RBF: Improve the interfaces to modify and view mount tables. Contributed by Gang Li.
(cherry picked from commit c394051a3d4d9d531f418503cb519606ae2b2e69)
2018-04-26 13:13:02 -07:00
Sunil G 8e0e33b0fd MAPREDUCE-7042. Killed MR job data does not move to mapreduce.jobhistory.done-dir when ATS v2 is enabled. Contributed by Rohith Sharma K S.
(cherry picked from commit 583a2f4edfdf71c32001cc2f2a03d16f9371d533)
2018-04-26 19:08:20 +05:30
Wangda Tan e6de818ef6 HADOOP-15411. AuthenticationFilter should use Configuration.getPropsWithPrefix instead of iterator. (Suma Shivaprasad via wangda)
Change-Id: Ia19458a43aceb4ffdb1e8eccc519655235d92ba9
(cherry picked from commit 3559d8b1dacf5cf207424de37cb6ba8865d26ffe)
2018-04-25 22:21:51 -07:00
Yiqun Lin caffd538af HDFS-13484. RBF: Disable Nameservices from the federation. Contributed by Inigo Goiri.
(cherry picked from commit 30fef0bf1e5c8c0ca073df99ad9b33cb0e4431a5)
2018-04-25 15:39:16 +08:00
Wangda Tan baa003035d YARN-8183. Fix ConcurrentModificationException inside RMAppAttemptMetrics#convertAtomicLongMaptoLongMap. (Suma Shivaprasad via wangda)
Change-Id: I347871d672001653a3afe2e99adefd74e0d798cd
(cherry picked from commit bb3c504764f807fccba7f28298a12e2296f284cb)
(cherry picked from commit 3043a93d46)
2018-04-24 17:49:32 -07:00
Junping Du 51194439ba YARN-7598. Document how to use classpath isolation for aux-services in YARN. Contributed by Xuan Gong.
(cherry picked from commit 56788d759f)
2018-04-24 18:30:26 +08:00
Yiqun Lin 14cfcf6b71 HDFS-13490. RBF: Fix setSafeMode in the Router. Contributed by Inigo Goiri.
(cherry picked from commit b06601acce)
2018-04-24 11:28:06 +08:00
Inigo Goiri 7bb2709c4a HDFS-13336. Test cases of TestWriteToReplica failed in windows. Contributed by Xiao Liang.
(cherry picked from commit df92a17e02)
2018-04-23 19:13:25 -07:00
Robert Kanter 101d9005dd HADOOP-15390. Yarn RM logs flooded by DelegationTokenRenewer trying to renew KMS tokens (xiaochen via rkanter)
(cherry picked from commit 7ab08a9c37)
2018-04-23 15:53:53 -07:00
Lei Xu 463fcfb50a Update CHANGES, RELEASENOTES, and jdiff for 3.0.2 release.
(cherry picked from commit f6ecb76d0b)

Conflicts:
	hadoop-project-dist/pom.xml
2018-04-23 14:17:29 -07:00
Chris Douglas 956ab12ede HDFS-13408. MiniDFSCluster to support being built on randomized base directory. Contributed by Xiao Liang
(cherry picked from commit f411de6a79)
(cherry picked from commit cf272c5179)
2018-04-23 11:15:15 -07:00
Arpit Agarwal e8f62357c0 HDFS-13433. webhdfs requests can be routed incorrectly in federated cluster. Contributed by Arpit Agarwal. 2018-04-23 10:09:16 -07:00
Yiqun Lin 45b11fe359 HDFS-13478. RBF: Disabled Nameservice store API. Contributed by Inigo Goiri.
(cherry picked from commit b6dae26f44)
2018-04-21 14:43:49 +08:00
Sangjin Lee 6becb3de0b
HDFS-10183. Prevent race condition during class initialization. Contributed by Pavel Avgustinov.
(cherry picked from commit f40969a141)
2018-04-20 21:10:39 -07:00
Jason Lowe 4bff2df137 YARN-7786. NullPointerException while launching ApplicationMaster. Contributed by lujie
(cherry picked from commit 766544c0b0)
2018-04-20 13:26:29 -05:00
Inigo Goiri f8330d969d HDFS-13453. RBF: getMountPointDates should fetch latest subdir time/date when parent dir is not present but /parent/child dirs are present in mount table. Contributed by Dibyendu Karmakar.
(cherry picked from commit 1134af9ad1)
2018-04-19 14:57:33 -07:00
Sunil G 070bee57a3 YARN-6827. [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart. Contributed by Rohith Sharma K S.
(cherry picked from commit 7d06806dfd)
2018-04-20 00:07:12 +05:30
Xiao Chen 9f19c3b03e HDFS-13430. Fix TestEncryptionZonesWithKMS failure due to HADOOP-14445.
(cherry picked from commit 6503593711)
2018-04-18 22:35:30 -05:00
Shashikant Banerjee 2c4b1c2b15
HADOOP-15396. Some java source files are executable
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit e4c39f3247)
2018-04-19 08:36:59 +09:00
Erik Krogen 1f8fd96eaf
HDFS-12828. OIV ReverseXML Processor fails with escaped characters
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 2d9e791a90)
2018-04-18 14:40:24 +09:00
Wei Yan 0124c7ffd6 HDFS-13466. RBF: Add more router-related information to the UI.
(cherry picked from commit e4313e7e47)
2018-04-17 15:04:05 -07:00
Inigo Goiri 282bbd56e8 HDFS-13462. Add BIND_HOST configuration for JournalNode's HTTP and RPC Servers. Contributed by Lukas Majercak.
(cherry picked from commit c9b33514b8)
2018-04-17 14:29:20 -07:00
Jason Lowe 391ac5cdd2 YARN-7189. Container-executor doesn't remove Docker containers that error out early. Contributed by Eric Badger 2018-04-17 09:45:55 -05:00
Inigo Goiri 688933e6c7 YARN-8165. Incorrect queue name logging in AbstractContainerAllocator. Contributed by Weiwei Yan.
(cherry picked from commit dd5e18c4ae)
2018-04-17 15:29:39 +05:30
Yiqun Lin 24bdad925e HDFS-13435. RBF: Improve the error loggings for printing the stack trace.
(cherry picked from commit c4d3636c21)
2018-04-17 11:26:13 +08:00
Virajith Jalaparti f06b55bbf1 HDFS-13311. RBF: TestRouterAdminCLI#testCreateInvalidEntry fails on Windows. Contributed by Inigo Goiri 2018-04-16 16:05:17 -07:00
Rohith Sharma K S 7e37979472 YARN-8156. Increase the default value of yarn.timeline-service.app-collector.linger-period.ms. Contributed by Charan Hebri.
(cherry picked from commit 669eb7bdea)
2018-04-14 11:10:16 +05:30
Wei-Chiu Chuang dc01e323ed HDFS-13330. ShortCircuitCache#fetchOrCreate never retries. Contributed by Gabor Bota.
(cherry picked from commit e66e287efe)
(cherry picked from commit ca8bb322be)
2018-04-13 12:20:01 -07:00
Erik Krogen bce57a139b HADOOP-14970. MiniHadoopClusterManager doesn't respect lack of format option. Contributed by Erik Krogen
(cherry picked from commit 1a407bc990)
2018-04-12 23:35:58 -07:00
Akira Ajisaka 64105868e9
HDFS-13436. Fix javadoc of package-info.java
(cherry picked from commit 9b0b9f2af2)
2018-04-13 13:25:19 +09:00
Sammi Chen ce7ebbe2cc HADOOP-14999. AliyunOSS: provide one asynchronous multi-part based uploading mechanism. Contributed by Genmao Yu.
(cherry picked from commit 6542d17ea4)
(cherry picked from commit e96c7bf82d)
2018-04-13 10:17:46 +08:00
Jason Lowe d416a0c9b7 YARN-8027. Setting hostname of docker container breaks for --net=host in docker 1.13. Contributed by Jim Brennan 2018-04-12 16:04:20 -05:00
Lei Xu 3717df89ee Preparing for 3.0.3 development 2018-04-12 13:57:46 -07:00
Eric E Payne 43d2ee9de6 YARN-8147. TestClientRMService#testGetApplications sporadically fails. Contributed by Jason Lowe
(cherry picked from commit 18844599ae)
2018-04-12 18:10:42 +00:00
Eric E Payne 081ea1ec39 YARN-8120. JVM can crash with SIGSEGV when exiting due to custom leveldb logger. Contributed by Jason Lowe.
(cherry picked from commit 6bb128dfb8)
2018-04-12 16:22:48 +00:00
Akira Ajisaka 94daa4f3b3
HDFS-13427. Fix the section titles of transparent encryption document.
(cherry picked from commit c7cd362afd)
2018-04-12 10:46:40 +09:00
Eric Yang f2cf11416c YARN-7810. Update TestDockerContainerRuntime to test with current user credential.
(contributed by Shane Kumpf)

            Cherry-picked from: 59828be197
2018-04-11 20:04:24 -04:00
Inigo Goiri 5fe2b97dd0 HDFS-13386. RBF: Wrong date information in list file(-ls) result. Contributed by Dibyendu Karmakar.
(cherry picked from commit 18de6f2042)
2018-04-11 12:03:57 -07:00
Inigo Goiri 670abc4121 HDFS-13428. RBF: Remove LinkedList From StateStoreFileImpl.java. Contributed by BELUGA BEHR.
(cherry picked from commit 6a881cd842fb4eab596a386b39670ea03536891a)
2018-04-11 10:41:40 -07:00
Wei Yan 8433f6256c HDFS-13045. RBF: Improve error message returned from subcluster. Contributed by Inigo Goiri. 2018-04-11 08:51:47 -07:00
Rohith Sharma K S 7cca3486b7 MAPREDUCE-7062. Update mapreduce.job.tags description for making use for ATSv2 purpose. Contributed by Charan Hebri.
(cherry picked from commit 6cc59a09e7)
2018-04-11 09:49:38 +05:30
Vrushali C ec258b8ed1 YARN-8073 TimelineClientImpl doesn't honor yarn.timeline-service.versions configuration. Contributed by Rohith Sharma K S
(cherry picked from commit 345e7624d5)
2018-04-11 09:49:25 +05:30
Xiao Chen 72acda1449 HADOOP-14445. Delegation tokens are not shared between KMS instances. Contributed by Xiao Chen and Rushabh S Shah.
(cherry picked from commit 583fa6ed48)
2018-04-10 15:45:48 -07:00