Commit Graph

16866 Commits

Author SHA1 Message Date
Haibo Chen 4f58533389 YARN-7128. The error message in TimelineSchemaCreator is not enough to find out the error. (Jinjiang Ling via Haibo Chen)
(cherry picked from commit 661f5eb0c6)
2017-09-11 16:22:06 -07:00
Ray Chiang 0b69a22f86 HADOOP-14655. Update httpcore version to 4.4.6. (rchiang)
(cherry picked from commit 088a18b44d)
2017-09-11 13:55:49 -07:00
Ray Chiang 14bec7043a HADOOP-14654. Update httpclient version to 4.5.3. (rchiang) 2017-09-11 13:43:48 -07:00
Andrew Wang cb95c442da Revert "HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah."
This reverts commit 0a6d5c0cf1.
2017-09-11 13:35:48 -07:00
Haibo Chen 1a2e8196d1 YARN-7181. CPUTimeTracker.updateElapsedJiffies can report negative usage. (Miklos Szegedi via Haibo Chen)
(cherry picked from commit d2d8f665e6)
2017-09-11 12:48:38 -07:00
Sunil G 07cbb81e8b YARN-7163. RMContext need not to be injected to webapp and other Always Running services. Contributed by Rohith Sharma K S.
(cherry picked from commit 722ee84194)
2017-09-11 10:36:29 +05:30
Arpit Agarwal b4dc2fa247 HDFS-10391. Always enable NameNode service RPC port. Contributed by Gergely Novak. 2017-09-09 09:16:51 -07:00
Sunil G ad09c8f299 YARN-7104. Improve Nodes Heatmap in new YARN UI with better color coding. Contributed by Da Ding.
(cherry picked from commit ab8368d2e0)
2017-09-09 06:54:26 +05:30
Sunil G 6b54eec371 YARN-7022. Improve click interaction in queue topology in new YARN UI. Contributed by Abdullah Yousufi.
(cherry picked from commit ed162b7aa0)
2017-09-09 06:42:55 +05:30
Sunil G fd63f8112b YARN-7075. Better styling for donut charts in new YARN UI. Contributed by Da Ding.
(cherry picked from commit 275980bb1e)
2017-09-09 06:33:14 +05:30
Sunil G f3c9b2e40e YARN-6992. Kill application button is visible even if the application is FINISHED in RM UI. Contributed by Suma Shivaprasad.
(cherry picked from commit 6f101e7df1)
2017-09-09 06:25:53 +05:30
Haibo Chen 8ff2523687 HADOOP-14847. Remove Guava Supplier and change to java Supplier in AMRMClient and AMRMClientAysnc. (Bharat Viswanadham via Haibo Chen)
(cherry picked from commit 8edc60531f)
2017-09-08 14:35:03 -07:00
Robert Kanter f5f343a665 MAPREDUCE-6953. Skip the testcase testJobWithChangePriority if FairScheduler is used (pbacsko via rkanter)
(cherry picked from commit a323f73bae)
2017-09-08 13:14:52 -07:00
John Zhuge bb107f5d28 HADOOP-14844. Remove requirement to specify TenantGuid for MSI Token Provider. Contributed by Atul Sikaria.
(cherry picked from commit a4661850c1)
2017-09-08 12:57:58 -07:00
Rohith Sharma K S 720718eecc YARN-7130. ATSv2 documentation changes post merge. Contributed by Varun Saxena.
(cherry picked from commit 0bfb3a2566)
2017-09-08 22:42:02 +05:30
Rohith Sharma K S e8e1a73cf5 YARN-7140. CollectorInfo should have Public visibility. Contributed by Varun Saxena.
(cherry picked from commit 4a83170be4)
2017-09-08 22:41:52 +05:30
Arun Suresh abe3085f23 YARN-6849. NMContainerStatus should have the Container ExecutionType. (Kartheek Muthyala via asuresh)
(cherry picked from commit 1f53ae7972)
2017-09-08 09:25:14 -07:00
Sunil G dfc174b747 YARN-6600. Introduce default and max lifetime of application at LeafQueue level. Contributed by Rohith Sharma K S.
(cherry picked from commit 56d93d2e39)
2017-09-08 20:06:06 +05:30
Steve Loughran 70c95d15e3
HADOOP-13421. Switch to v2 of the S3 List Objects API in S3A.
Contributed by Aaron Fabbri

(cherry picked from commit 5bbca80428)
2017-09-08 12:08:36 +01:00
Xiao Chen 3a3762d9e7 HDFS-12400. Provide a way for NN to drain the local key cache before re-encryption.
(cherry picked from commit 420baed31fdd811ac94c74dc53502ee79f37ba91)
2017-09-07 20:51:09 -07:00
Andrew Wang 986e8fc553 HDFS-12218. Addendum. Rename split EC / replicated block metrics in BlockManager.
(cherry picked from commit 4e50dc976a)
2017-09-07 16:57:37 -07:00
Andrew Wang 4c1f8f3b26 HDFS-12218. Rename split EC / replicated block metrics in BlockManager.
(cherry picked from commit 40c2f31f8d)
2017-09-07 16:57:35 -07:00
Xiao Chen 9a3334ec0f HDFS-12369. Edit log corruption due to hard lease recovery of not-closed file which has snapshots.
(cherry picked from commit 3964b131f3f0131a663377685950d1b7bd3fe63d)
2017-09-07 16:30:26 -07:00
Jason Lowe 7287932397 YARN-6930. Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager. Contributed by Shane Kumpf
(cherry picked from commit b0b535d9d5)
2017-09-07 16:25:41 -05:00
Steve Loughran 5757600b8d
HADOOP-14774. S3A case "testRandomReadOverBuffer" failed due to improper range parameter.
Contributed by Yonger.

(cherry picked from commit 83449abb40)
2017-09-07 19:58:03 +01:00
Arun Suresh 05b4abf537 YARN-6978. Add updateContainer API to NMClient. (Kartheek Muthyala via asuresh)
(cherry picked from commit c41118a7f8)
2017-09-07 10:28:18 -07:00
Yongjun Zhang 5c9ffa1cf9 HDFS-12357. Let NameNode to bypass external attribute provider for configured users. Contributed by Yongjun Zhang, Arun Suresh.
(cherry picked from commit d77ed238a9)
2017-09-07 10:48:18 -07:00
Steve Loughran e5bb78d3d9
HADOOP-14520. WASB: Block compaction for Azure Block Blobs.
Contributed by Georgi Chalakov

(cherry picked from commit 13eda50003)
2017-09-07 18:38:24 +01:00
Kai Zheng 7415a21ee2 HDFS-12402. Refactor ErasureCodingPolicyManager and related codes. Contributed by Sammi Chen 2017-09-07 20:37:11 +08:00
Junping Du 2608b53910 YARN-7144. Log Aggregation controller should not swallow the exceptions when it calls closeWriter and closeReader. Contributed by Xuan Gong.
(cherry picked from commit 22de9449f8)
2017-09-06 15:02:23 -07:00
Junping Du 00594eb686 YARN-7148. TestLogsCLI fails in trunk and branch-2 and javadoc error. Contributed by Xuan Gong.
(cherry picked from commit 63231a2a30)
2017-09-06 15:01:35 -07:00
Jason Lowe b2c564bca1 HADOOP-14827. Allow StopWatch to accept a Timer parameter for tests. Contributed by Erik Krogen
(cherry picked from commit dd814946f6)
2017-09-06 16:05:31 -05:00
Jason Lowe 6ec611d8c1 YARN-7164. TestAMRMClientOnRMRestart fails sporadically with bind address in use. Contributed by Jason Lowe
(cherry picked from commit 704267cb49)
2017-09-06 15:28:45 -05:00
John Zhuge 3dd5444b4d HADOOP-14103. Sort out hadoop-aws contract-test-options.xml. Contributed by John Zhuge.
(cherry picked from commit 50506e90a8)
2017-09-06 11:33:43 -07:00
Chris Douglas 270bca6aec HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. Contributed by Gera Shegalov
(cherry picked from commit 1f3bc63e67)
2017-09-05 23:52:08 -07:00
Xiaoyu Yao fd951e3a37 HADOOP-14839. DistCp log output should contain copied and deleted files and directories. Contributed by Yiqun Lin.
(cherry picked from commit 7ba61235dba87bc292134194044d54d9a12a4d7c)
2017-09-05 23:35:39 -07:00
Kai Zheng 3c71bf79f2 HDFS-12392. Writing striped file failed due to different cell size. Contributed by Sammi Chen 2017-09-06 13:34:53 +08:00
Andrew Wang 94b56dde01 HDFS-12377. Refactor TestReadStripedFileWithDecoding to avoid test timeouts.
(cherry picked from commit d4035d42f0)
2017-09-05 16:33:36 -07:00
Wei-Chiu Chuang c16ecf0fe8 HADOOP-14688. Intern strings in KeyVersion and EncryptedKeyVersion. Contributed by Xiao Chen.
(cherry picked from commit ad32759fd9)
2017-09-05 15:13:20 -07:00
Steve Loughran 727e79a78e HADOOP-14820 Wasb mkdirs security checks inconsistent with HDFS.
Contributed by Sivaguru Sankaridurg

(cherry picked from commit 792eff9ea7)
2017-09-05 14:21:16 -07:00
Xiao Chen 663e4eac27 HDFS-12359. Re-encryption should operate with minimum KMS ACL requirements.
(cherry picked from commit 0ba8ff4b77)
2017-09-05 14:20:44 -07:00
Xiao Chen b9d3e2eb70 HDFS-12383. Re-encryption updater should handle canceled tasks better.
(cherry picked from commit 633c1ea455)
2017-09-05 14:20:05 -07:00
Kai Zheng b7739b468e HDFS-12388. A bad error message in DFSStripedOutputStream. Contributed by Huafeng Wang
(cherry picked from commit 5dba54596a)
2017-09-05 14:19:16 -07:00
Andrew Wang c333ae8b36 HDFS-11882. Precisely calculate acked length of striped block groups in updatePipeline.
(cherry picked from commit ccd2ac60ec)
2017-09-05 14:16:07 -07:00
Varun Saxena 5323335fca YARN-7152. [ATSv2] Registering timeline client before AMRMClient service init throw exception (Rohith Sharma K S via Varun Saxena)
(cherry picked from commit ef87d34a0e)
2017-09-04 20:21:08 +05:30
Oleg Danilov 305528768c
YARN-7023. Incorrect ReservationId.compareTo() implementation.
This closes #262

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit c5281a85e1)
2017-09-01 21:35:03 +02:00
Jitendra Pandey 063b6d0c93 HADOOP-14674. Correct javadoc for getRandomizedTempPath. Contributed by Mukul Kumar Singh. 2017-09-01 10:17:12 -07:00
Jason Lowe 99a7f5d451 YARN-7120. CapacitySchedulerPage NPE in "Aggregate scheduler counts" section. Contributed by Eric Payne 2017-09-01 11:09:14 -05:00
Allen Wittenauer a3fee475f7
HADOOP-14414. Calling maven-site-plugin directly for docs profile is unnecessary (Andras Bokor via aw) 2017-09-01 08:38:30 -07:00
Sunil G a756704f5a YARN-7071. Add vcores and number of containers in new YARN UI node heat map. Contributed by Abdullah Yousufi. 2017-09-01 20:46:39 +05:30