Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,862 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

20862 Commits

Author SHA1 Message Date
Yi Sheng d39ebbfebc HADOOP-16555. Update commons-compress to 1.19. (#1425) Contributed by YiSheng Lien. 
(cherry picked from commit 1843c4688a)

Conflicts:
	LICENSE-binary
 2019-09-13 11:14:49 -07:00
Surendra Singh Lilhore eb1ddcd04c HDFS-14699. Erasure Coding: Storage not considered in live replica when replication streams hard limit reached to threshold. Contributed by Zhao Yi Ming. 
(cherry picked from commit d1c303a497)
 2019-09-12 19:25:50 +05:30
Takanobu Asanuma 8e27d6b4c9 HDFS-14838. RBF: Display RPC (instead of HTTP) Port Number in RBF web UI. Contributed by Xieming Li 
(cherry picked from commit c255333e20)
 2019-09-11 17:03:23 +09:00
Jonathan Hung 1dbf87c9ff YARN-9824. Fall back to configured queue ordering policy class name 
(cherry picked from commit f8f8598ea5)
 2019-09-10 15:26:57 -07:00
bibinchundatt e10050678d YARN-8948. PlacementRule interface should be for all YarnSchedulers. Contributed by Bibin A Chundatt. 
(cherry picked from commit a68d766e87)
 2019-09-09 19:03:40 -07:00
Abhishek Modi f6cc887f35 YARN-9821. NM hangs at serviceStop when ATSV2 Backend Hbase is Down. Contributed by Prabhu Joseph. 2019-09-09 15:44:45 +05:30
Jonathan Hung 1f0449ddfb YARN-9820. RM logs InvalidStateTransitionException when app is submitted. Contributed by Prabhu Joseph 2019-09-09 00:24:17 -07:00
Jonathan Hung 45220d1157 YARN-9764. Print application submission context label in application summary. Contributed by Manoj Kumar 
(cherry picked from commit 43e389b980)
 2019-09-08 19:11:47 -07:00
Rohith Sharma K S 7d5bb2ebb7 Preparing for 3.2.2-SNAPSHOT development. 2019-09-07 08:52:08 +05:30
Wangda Tan 0e77347972 YARN-9813. RM does not start on JDK11 when UIv2 is enabled. (Adam Antal/Eric Yang via wangda) 
Change-Id: I18b8edc930b2efa0652f59c246931ad0d46827f3
(cherry picked from commit 34b82e6da0)
 2019-09-06 19:19:05 -07:00
Tao Yang 9ee257e353 YARN-8995. Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time(addendum). Contributed by Jonathan Hung. 2019-09-07 08:25:15 +08:00
Tao Yang cfce39023d YARN-9795. ClusterMetrics to include AM allocation delay. Contributed by Fengnan Li. 2019-09-07 07:53:46 +08:00
Tao Yang c002186ee1 YARN-9817. Fix failing testcases due to not initialized AsyncDispatcher - ArithmeticException: / by zero. Contributed by Prabhu Joseph. 2019-09-07 07:40:04 +08:00
Jungtaek Lim (HeartSaVioR) 8cda5a6598
HADOOP-16255. Add ChecksumFs.rename(path, path, boolean) 
Contributed by Jungtaek Lim

Change-Id: If00a4d7d30456c08eb2b0f7e2b242197bc4ee05d
 2019-09-06 21:54:09 +01:00
Jonathan Hung 9c9ff07249 YARN-9763. Print application tags in application summary. Contributed by Manoj Kumar 2019-09-06 10:49:43 -07:00
Jonathan Hung 1f685efc73 YARN-9761. Allow overriding application submissions based on server side configs. Contributed by Pralabh Kumar 2019-09-06 10:13:12 -07:00
Xiaoyu Yao ebb3b8add0
HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun. 
(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)
 2019-09-05 15:33:54 -07:00
Xiaoyu Yao 53d1bfe680
Revert "HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun." 
This reverts commit 259c6bb0c7.
 2019-09-05 15:31:14 -07:00
Jonathan Hung 79ca399a30 YARN-9810. Add queue capacity/maxcapacity percentage metrics. Contributed by Shubham Gupta 
(cherry picked from commit 0ccf4b0fe1)
 2019-09-05 14:05:45 -07:00
Billie Rinaldi 66627749d0 YARN-9718. Fixed yarn.service.am.java.opts shell injection. Contributed by Eric Yang 
(cherry picked from commit 2e2e5401f2)
 2019-09-05 12:54:20 -07:00
Rohith Sharma K S 4d9c5300e2 YARN-8567. Fetching yarn logs fails for long running application if it is not present in timeline store. Contributed by Tarun Parimi. 2019-09-05 18:16:35 +05:30
Eric Yang b87a727ff4 YARN-9374. Improve Timeline service resilience when HBase is unavailable. 
Contributed by Prabhu Joseph and Szilard Nemeth
 2019-09-05 16:32:18 +05:30
Eric Yang 02779cdc3a YARN-8499 ATSv2 Generalize TimelineStorageMonitor. 
Contributed by Prabhu Joseph
 2019-09-05 16:31:35 +05:30
Eric Yang 6110af2d1d YARN-7537. Add ability to load hbase config from distributed file system. 
Contributed by Prabhu Joseph
 2019-09-05 16:28:04 +05:30
Vrushali C bcacb57114 YARN-9335 [atsv2] Restrict the number of elements held in timeline collector when backend is unreachable for async calls. Contributed by Abhishesk Modi. 2019-09-05 16:27:39 +05:30
Vrushali C 6acc1a2bd0 YARN-9382 Publish container killed, paused and resumed events to ATSv2. Contributed by Abhishesk Modi. 2019-09-05 15:39:38 +05:30
Vrushali C f52a88fdc8 YARN-9303 Username splits won't help timelineservice.app_flow table. Contributed by Prabhu Joseph. 2019-09-05 15:39:38 +05:30
Giovanni Matteo Fumarola 998aa3de2c YARN-9418. ATSV2 /apps//entities/YARN_CONTAINER rest api does not show metrics. Contributed by Prabhu Joseph. 2019-09-05 15:39:38 +05:30
Rohith Sharma K S 8de93fca3c YARN-9389. FlowActivity and FlowRun table prefix is wrong. Contributed by Prabhu Joseph. 2019-09-05 15:39:38 +05:30
Rohith Sharma K S 0ccc5a2695 YARN-9387. Update document for ATS HBase Custom tablenames (-entityTableName). Contributed by Prabhu Joseph. 2019-09-05 15:39:38 +05:30
Vrushali C d451ff7534 YARN-3841 [atsv2 Storage implementation] Adding retry semantics to HDFS backing storage. Contributed by Abhishek Modi. 2019-09-05 15:39:38 +05:30
Vrushali C 66e1599761 YARN-3879 [Storage implementation] Create HDFS backing storage implementation for ATS reads. Contributed by Abhishek Modi. 2019-09-05 15:39:38 +05:30
Tao Yang 6f9764076a YARN-8995. Log events info in AsyncDispatcher when event queue size cumulatively reaches a certain number every time. Contributed by zhuqi. 2019-09-05 16:53:16 +08:00
Vrushali C 84a9c3f999 YARN-5336 Limit the flow name size & consider cleanup for hex chars. Contributed by Sushil Ks 2019-09-05 12:43:02 +05:30
Rohith Sharma K S 108c569e3b YARN-6735. Have a way to turn off container metrics from NMs. Contributed by Abhishek Modi. 2019-09-05 12:42:06 +05:30
Rohith Sharma K S 5345508fa3 YARN-6149. Allow port range to be specified while starting NM Timeline collector manager. Contributed by Abhishek Modi. 2019-09-05 12:38:37 +05:30
Suma Shivaprasad 0a6f90d4fc YARN-9034. ApplicationCLI should have option to take clusterId. Contributed by Rohith Sharma K S. 2019-09-05 12:38:07 +05:30
Rohith Sharma K S 4a4a892d32 YARN-7754. [Atsv2] Update document for running v1 and v2 TS. Contributed by Suma Shivaprasad. 2019-09-05 12:31:37 +05:30
Rohith Sharma K S a3496a368b YARN-8871. Document ATSv2 integrated LogWebService. Contributed by Suma Shivaprasad. 2019-09-05 12:30:50 +05:30
Rohith Sharma K S 252afdc8e6 YARN-9804. Update ATSv2 document for latest feature supports. 2019-09-05 09:00:22 +05:30
Xiaoyu Yao 259c6bb0c7
HDFS-14633. The StorageType quota and consume in QuotaFeature is not handled for rename. Contributed by Jinglun. 
(cherry picked from commit 62d71fbac3789c7d484bc76ced9ec7fa6ff94de1)
 2019-09-03 09:12:19 -07:00
Zhankun Tang 269aa7ebfe YARN-9785. Fix DominantResourceCalculator when one resource is zero. Contributed by Bibin A Chundatt, Sunil Govindan, Bilwa S T. 
(cherry picked from commit bb26514ba9)
 2019-09-03 15:02:15 +08:00
bibinchundatt 1e6095f16b YARN-9797. LeafQueue#activateApplications should use resourceCalculator#fitsIn. Contributed by Bilwa S T. 
(cherry picked from commit 03489124ea)
 2019-09-03 11:55:13 +05:30
Stephen O'Donnell 61fd1a74a1 HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 915cbc91c0)
 2019-09-02 10:06:39 -07:00
Wei-Chiu Chuang 84b2fe4b10 Revert "HDFS-14706. Checksums are not checked if block meta file is less than 7 bytes. Contributed by Stephen O'Donnell." 
This reverts commit 9c0d6e1657.
 2019-09-02 10:06:39 -07:00
Akira Ajisaka a453f38015 YARN-9162. Fix TestRMAdminCLI#testHelp. Contributed by Ayush Saxena. 
(cherry picked from commit 5db7c49062)
 2019-08-30 17:52:07 -07:00
Rohith Sharma K S 2fc4123fe0 YARN-9714. ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby. Contributed by Tao Yang. 2019-08-30 10:36:23 +05:30
Brian Grunkemeyer 1c685a3aba HADOOP-15998. Ensure jar validation works on Windows. 
* use a different path separator for artifacts to test
* fail if and commands fail (including the jar listing)
* handle different line endings from jar listing
* make sure we have bash 3.1+

Co-authored-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Abhishek Modi <abmodi@apache.org>
Signed-off-by: Rohith Sharma K S <rohithsharmaks@apache.org>
(cherry picked from commit b86582ce2b8b00c128add054bcb80951c38cb3d3)
 2019-08-29 23:08:49 -05:00
Ayush Saxena 3edffd90c9 HDFS-12212. Options.Rename.To_TRASH is considered even when Options.Rename.NONE is specified. Contributed by Vinayakumar B. 2019-08-30 08:58:12 +05:30
leosunli b516d2ea7b Make DataNodePeerMetrics#minOutlierDetectionSamples configurable (#1314). Contributed by Lisheng Sun. 
Signed-off-by: sunlisheng <sunlisheng@xiaomi.com>
(cherry picked from commit 915271245b)
 2019-08-29 18:46:15 -07:00