Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,145 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17145 Commits

Author SHA1 Message Date
Akira Ajisaka a8be4b559a
HDFS-12889. Addendum patch to add missing file. 
(cherry picked from commit 6cca5b3bcb)
 2017-12-07 13:23:58 +09:00
Robert Kanter cdf305c337 YARN-6483. addendum to skip failing test (asuresh via rkanter) 2017-12-06 12:10:59 -08:00
Weiwei Yang 8bfd30b921 YARN-7610. Extend Distributed Shell to support launching job with opportunistic containers. Contributed by Weiwei Yang. 
(cherry picked from commit 40b0045ebe)
 2017-12-06 19:10:34 +08:00
Xiao Chen bf79246c5d HDFS-12872. EC Checksum broken when BlockAccessToken is enabled. 
(cherry picked from commit 56b1ff80dd)
 2017-12-05 20:48:46 -08:00
Weiwei Yang 48af34571f YARN-7611. Node manager web UI should display container type in containers page. Contributed by Weiwei Yang. 
(cherry picked from commit 05c347fe51)
 2017-12-06 12:24:00 +08:00
Akira Ajisaka c81057d936
HDFS-12889. Router UI is missing robots.txt file. Contributed by Bharat Viswanadham. 
(cherry picked from commit 44b06d34a5)
 2017-12-06 11:41:40 +09:00
Wangda Tan 5cb1b97905 YARN-7381. Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml. (Xuan Gong via wangda) 
Change-Id: I1ed58dafad5cc276eea5c0b0813cf04f57d73a87
(cherry picked from commit 0311cf0535)
 2017-12-05 13:10:15 -08:00
Akira Ajisaka 0a886461b5
HADOOP-14985. Remove subversion related code from VersionInfoMojo.java. Contributed by Ajay Kumar. 
(cherry picked from commit 9f1bdafedb)
 2017-12-05 14:31:21 +09:00
Sean Mackrory 486311cdc4 HADOOP-15058. create-release site build outputs dummy shaded jars due to skipShade. Contributed by Andrew Wang. 
(cherry picked from commit 5533648241)
 2017-12-04 15:43:20 -07:00
Xiao Chen 55fa509eb6 HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah. 
(cherry picked from commit 404eab4dc0)
 2017-12-04 10:49:58 -08:00
Sunil G f034668b91 YARN-6907. Node information page in the old web UI should report resource types. Contributed by Gergely Novák. 
(cherry picked from commit 81f6e46b2f)
 2017-12-04 12:19:27 +05:30
Arun Suresh 6f123aae41 YARN-7587. Skip dispatching opportunistic containers to nodes whose queue is already full. (Weiwei Yang via asuresh) 
(cherry picked from commit 37ca416950)
 2017-12-03 22:23:46 -08:00
Chris Douglas 2399c96ee7 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit 42307e3c3a)
 2017-12-02 23:32:44 -08:00
Jason Lowe 5db3ca39dc YARN-7455. quote_and_append_arg can overflow buffer. Contributed by Jim Brennan 
(cherry picked from commit 60f95fb719)
 2017-12-01 15:48:33 -06:00
Jason Lowe f222b9d362 YARN-7589. TestPBImplRecords fails with NullPointerException. Contributed by Daniel Templeton 
(cherry picked from commit 25df505421)
 2017-12-01 15:38:57 -06:00
Jason Lowe 0dd7f1f4e8 MAPREDUCE-5124. AM lacks flow control for task events. Contributed by Peter Bacsko 
(cherry picked from commit 21d3627355)
 2017-12-01 14:10:02 -06:00
Wei-Chiu Chuang 83b62a8eed HDFS-12836. startTxId could be greater than endTxId when tailing in-progress edit log. Contributed by Chao Sun. 
(cherry picked from commit 0faf506245)
 2017-12-01 12:03:04 -08:00
Chris Douglas 6266c52680 Revert "HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak" 
This reverts commit 482fd5a880.
 2017-12-01 11:19:17 -08:00
Chris Douglas 482fd5a880 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit 5304698dc8)
 2017-12-01 10:30:08 -08:00
Konstantin V Shvachko def87db9cb HDFS-12638. Delete copy-on-truncate block along with the original block, when deleting a file being truncated. Contributed by Konstantin Shvachko. 
(cherry picked from commit 60fd0d7fd7)
 2017-11-30 18:27:16 -08:00
Junping Du 58d849b858 YARN-7558. yarn logs command fails to get logs for running containers if UI authentication is enabled. Contributed by Xuan Gong. 
(cherry picked from commit a409425986)
 2017-11-30 13:49:00 -08:00
Jason Lowe f072caa0bc YARN-7495. Improve robustness of the AggregatedLogDeletionService. Contributed by Jonathan Eagles 
(cherry picked from commit 5cfaee2e6d)
 2017-11-30 12:40:45 -06:00
Daniel Templeton 40372be7bb YARN-7541. Node updates don't update the maximum cluster capability for resources other than CPU and memory 
(cherry picked from commit 8498d287cd)
 2017-11-30 09:26:25 -08:00
Robert Kanter 2c2ff7da05 HADOOP-13493. Compatibility Docs should clarify the policy for what takes precedence when a conflict is found (templedf via rkanter) 
(cherry picked from commit 75a3ab88f5)
 2017-11-30 07:39:51 -08:00
Kihwal Lee ee4525e071 HDFS-11754. Make FsServerDefaults cache configurable. Contributed by Mikhail Erofeev. 
(cherry picked from commit 53509f295b)
 2017-11-29 15:12:47 -06:00
Wei Yan 4b1a2152eb HDFS-12835. Fix the javadoc errors in Router-based federation. 
(cherry picked from commit 301641811d)
 2017-11-29 09:59:17 -08:00
Konstantin V Shvachko 4cbd5ea42b HDFS-12832. INode.getFullPathName may throw ArrayIndexOutOfBoundsException lead to NameNode exit. Contribuited by Konstantin Shvachko. 
(cherry picked from commit d331762f24)
 2017-11-28 17:18:21 -08:00
Jason Lowe a4f1e3036d YARN-6647. RM can crash during transitionToStandby due to InterruptedException. Contributed by Bibin A Chundatt 
(cherry picked from commit a2c7a73e33)
 2017-11-28 11:19:43 -06:00
Steve Loughran 8bf74f325a HADOOP-15042. Azure PageBlobInputStream.skip() can return negative value when numberOfPagesRemaining is 0. 
Contributed by Rajesh Balamohan

(cherry picked from commit 0ea182d0fa)
 2017-11-28 11:57:12 +00:00
Yiqun Lin 72d0be964d HDFS-12858. Add router admin commands usage in HDFS commands reference doc. Contributed by Yiqun Lin. 
(cherry picked from commit 94bed50471)
 2017-11-28 11:52:29 +08:00
Yufei Gu c0ab3c8407 YARN-7363. ContainerLocalizer don't have a valid log4j config in case of Linux container executor. (Contributed by Yufei Gu) 
(cherry picked from commit d8923cdbf1)
 2017-11-27 14:33:13 -08:00
Yufei Gu f335d509d3 YARN-7290. Method canContainerBePreempted can return true when it shouldn't. (Contributed by Steven Rand) 
(cherry picked from commit 2bde3aedf1)
 2017-11-24 23:39:03 -08:00
Wangda Tan 6e038165a6 YARN-7509. AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby. (Tao Yang via wangda) 
Change-Id: I7477fe355419fd4a0a6e2bdda7319abad4c4c748
(cherry picked from commit 834e91ee91)
 2017-11-23 20:02:34 -08:00
Xiao Chen 4f71c27f2e HADOOP-15067. GC time percentage reported in JvmMetrics should be a gauge, not counter. Contributed by Misha Dmitriev. 
(cherry picked from commit d162252d7a)
 2017-11-23 09:02:07 -08:00
Arun Suresh 5884b8a80a YARN-6483. Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM. (Juan Rodriguez Hortala via asuresh) 
(cherry picked from commit b46ca7e73b)
 2017-11-22 19:19:52 -08:00
Yufei Gu b85eb9bb53 YARN-7524. Remove unused FairSchedulerEventLog. (Contributed by Wilfred Spiegelenburg) 
(cherry picked from commit 4cc9479dae)
 2017-11-22 14:19:36 -08:00
Kihwal Lee 1078d477c3 HDFS-12754. Lease renewal can hit a deadlock. Contributed by Kuhu Shukla. 
(cherry picked from commit 738d1a206a)
 2017-11-22 13:02:45 -06:00
Lei Xu a5a86680a4 HDFS-12847. Regenerate editsStored and editsStored.xml in HDFS tests. Contributed by Lei (Eddy) Xu. 2017-11-22 10:23:10 -08:00
Chris Douglas 03f0b8b3f2 MAPREDUCE-7011. TestClientDistributedCacheManager::testDetermineCacheVisibilities assumes all parent dirs set other exec 
(cherry picked from commit 782ba3bf9d)
 2017-11-21 20:42:59 -08:00
yufei 717634e45c YARN-7513. Remove the scheduler lock in FSAppAttempt.getWeight() (Contributed by Wilfred Spiegelenburg) 
(cherry picked from commit 03c311eae3)
 2017-11-21 10:35:06 -08:00
Haibo Chen b419e8aa25 YARN-7531. ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType(). 2017-11-21 09:12:27 -08:00
Akira Ajisaka 4face7e015
HADOOP-15046. Document Apache Hadoop does not support Java 9 in BUILDING.txt. Contributed by Hanisha Koneru. 
(cherry picked from commit 0ed44f2565)
 2017-11-22 01:08:27 +09:00
Wangda Tan adc5157a3c YARN-7527. Over-allocate node resource in async-scheduling mode of CapacityScheduler. (Tao Yang via wangda) 
Change-Id: I51ae6c2ab7a3d1febdd7d8d0519b63a13295ac7d
(cherry picked from commit 0d781dd03b)
 2017-11-20 13:14:17 -08:00
bibinchundatt fbcadfe3c4 YARN-7489. ConcurrentModificationException in RMAppImpl#getRMAppMetrics. Contributed by Tao Yang. 
(cherry picked from commit b5b81a4f08)
 2017-11-18 20:01:01 +05:30
bibinchundatt ae8d1b3c34 YARN-7525. Incorrect query parameters in cluster nodes REST API document. Contributed by Tao Yang. 
(cherry picked from commit 96e6a99360)
 2017-11-18 19:11:40 +05:30
Inigo Goiri 3cd5224693 HDFS-12801. RBF: Set MountTableResolver as default file resolver. Contributed by Inigo Goiri. 
(cherry picked from commit e182e77794)
 2017-11-17 10:08:04 -08:00
Varun Vasudev 6681e7238b YARN-7430. Enable user re-mapping for Docker containers by default. Contributed by Eric Yang. 
(cherry picked from commit 5f0b238a11)
 2017-11-17 12:05:19 +05:30
Haibo Chen 9bbe7eb226 YARN-7390. All reservation related test cases failed when TestYarnClient runs against Fair Scheduler. (Yufei Gu via Haibo Chen) 
(cherry picked from commit 28d0fcbef4)
 2017-11-16 10:49:40 -08:00
Sunil G c3fb49667a YARN-7469. Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit. Contributed by Eric Payne. 
(cherry picked from commit 61ace174cd)
 2017-11-16 22:35:22 +05:30
Weiwei Yang f9f268cf52 HDFS-12814. Add blockId when warning slow mirror/disk in BlockReceiver. Contributed by Jiandan Yang. 2017-11-16 16:23:13 +08:00