Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,586 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9586 Commits

Author SHA1 Message Date
Akira Ajisaka 80ed1050b9
Update CHANGES.txt for YARN-6719. 2017-06-19 16:49:59 +09:00
Naganarasimha 0dcd73749d YARN-6719. Fix findbugs warnings in SLSCapacityScheduler.java. Contributed by Akira Ajisaka. 
(cherry picked from commit 582bdfd423)
 2017-06-19 12:53:56 +05:30
Akira Ajisaka f36da00c1f
HDFS-11583. Parent spans are not initialized to NullScope for every DFSPacket. Contributed by Masatake Iwasaki. 2017-06-15 14:15:36 +09:00
Akira Ajisaka 59fab4ea04
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin. 2017-06-15 13:49:53 +09:00
Kihwal Lee 11e6c96788 HADOOP-14440. Add metrics for connections dropped. Contributed by Eric Badger. 
(cherry picked from commit abdd609e51)
(cherry picked from commit 9854682ea4)
 2017-06-12 09:45:52 -07:00
Chris Nauroth b6f3e1acae YARN-5121. fix some container-executor portability issues. Contributed by Allen Wittenauer. Backport YARN-6698 by Akira Ajisaka 
(cherry picked from commit ef501b1a0b)
(cherry picked from commit 384803d09ac45886e74a0501f4b419a2b756c20c)
 2017-06-09 18:04:46 -07:00
Varun Vasudev b5f25a1a56
YARN-4017. container-executor overuses PATH_MAX. Contributed by Sidharta Seethana 
(cherry picked from commit 5b6bae0094)
(cherry picked from commit 34b8142802)
 2017-06-08 14:53:59 +09:00
Zhe Zhang a91a1031e3 HDFS-11743. Revert the incompatible fsck reporting output in HDFS-7933 from branch-2.7. 2017-06-07 08:59:28 -07:00
Vinayakumar B d2ec34d556 HDFS-11708. Positional read will fail if replicas moved to different DNs after stream is opened (Contributed by Vinayakumar B) 2017-06-07 10:53:01 +05:30
Andrew Wang db81fbbab1 HDFS-8549. Abort the balancer if an upgrade is in progress. Contributed by Andrew Wang. Backport HDFS-11808 by Akira Ajisaka. 
(cherry picked from commit a7a7768341)
 2017-06-05 17:27:52 -07:00
Christopher Douglas f8969e2208 YARN-1471. Preserve scheduler typeinfo in simulator to work with resource monitors. 
Contributed by Carlo Curino. Backport by Ye Zhou.

(cherry picked from commit e07f3c87cd)
 2017-06-05 16:35:00 -07:00
Karthik Kambatla abf959f57a YARN-4927. TestRMHA#testTransitionedToActiveRefreshFail fails with FairScheduler. (Bibin A Chundatt via kasha) 
(cherry picked from commit ff95fd547b)
 2017-06-05 21:46:12 +05:30
Sunil G d1f71aaf02 YARN-5988. RM unable to start in secure setup. Contributed by Ajith S. 2017-06-04 14:04:12 +05:30
rohithsharmaks 647077f3f1 YARN-4250. NPE in AppSchedulingInfo#isRequestLabelChanged. (Brahma Reddy Battula via rohithsharmaks) 
(cherry picked from commit d6c8bad869)
 2017-06-03 14:04:49 -07:00
Wangda Tan 12f819a6b7 YARN-4140. RM container allocation delayed incase of app submitted to Nodelabel partition. (Bibin A Chundatt via wangda) Backport by Jonathan Hung. 
(cherry picked from commit def374e666)
 2017-06-03 13:59:36 -07:00
Naganarasimha 4f2ff8540b YARN-4925. ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression. Contributed by Bibin A Chundatt 
(cherry picked from commit f04c81c9ce)
 2017-06-02 16:53:38 -07:00
Xiao Chen 67e87c9aff HADOOP-14474. Use OpenJDK 7 instead of Oracle JDK 7 to avoid oracle-java7-installer failures. Contributed by Akira Ajisaka. 
(cherry picked from commit 5e40efe0ec)
(cherry picked from commit d946387850)

Conflicts:
	dev-support/docker/Dockerfile
 2017-06-02 09:36:08 -07:00
Kihwal Lee d3b86234b2 HDFS-11856. Ability to re-add upgrading nodes to pipeline for future pipeline updates. Contributed by Vinayakumar B. 2017-06-01 16:45:55 -05:00
Kihwal Lee 01cdea732f HDFS-5042. Completed files lost after power failure. Contributed by Vinayakumar B. 2017-06-01 12:41:00 -05:00
Brahma Reddy Battula 38bc12c683 Updating CHANGES.txt for HDFS-11078 2017-06-02 00:21:12 +08:00
Brahma Reddy Battula 2b19c7b3ff HDFS-11893. Fix TestDFSShell.testMoveWithTargetPortEmpty failure. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0dcf843c00)
 2017-06-01 22:53:06 +08:00
Sunil G fd112535c8 YARN-5333. Some recovered apps are put into default queue when RM HA. Contributed by Jun Gong. 2017-06-01 11:19:37 +05:30
Kihwal Lee 1903665b23 HDFS-11648. Lazy construct the IIP pathname. Contributed by Daryn Sharp. 
(cherry picked from commit 8ed230c805)
(cherry picked from commit 9dfe0b3515)
 2017-05-31 08:50:26 -07:00
Kihwal Lee 81712e84fb HDFS-10619. Cache path in InodesInPath. Contributed by Daryn Sharp. 
(cherry picked from commit 90020624b0)
(cherry picked from commit 3a89a8814f)
 2017-05-31 08:50:26 -07:00
Akira Ajisaka fd834915f2
Update CHANGES.txt for YARN-6304. 2017-05-30 18:05:05 +09:00
Junping Du b60e11e6bf YARN-6304. Skip rm.transitionToActive call to RM if RM is already active. Contributed by Rohith Sharma K S. 
(cherry picked from commit 6ed9d36224)
 2017-05-30 14:19:27 +05:30
Kihwal Lee cafee1109c HDFS-8674. Improve performance of postponed block scans. Contributed by Daryn Sharp. 
(cherry picked from commit 0d8a35bd6d)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2017-05-26 19:00:03 -07:00
Inigo Goiri 948d0ac72d Fix NPE in LazyPersistFileScrubber. Contributed by Inigo Goiri. 
(cherry picked from commit 303c8dc9b6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
 2017-05-26 13:36:34 -07:00
Brahma Reddy Battula 724a5f3dbc HDFS-11445. FSCK shows overall health stauts as corrupt even one replica is corrupt. Contributed by Brahma Reddy Battula. 2017-05-25 23:00:35 +08:00
Steve Loughran f225b5514f HADOOP-13026 Should not wrap IOExceptions into a AuthenticationException in KerberosAuthenticator. Xuan Gong via stevel 2017-05-24 19:00:18 -07:00
Vinayakumar B b6afb4a951 HDFS-6291. FSImage may be left unclosed in BootstrapStandby#doRun() ( Contributed by Sanghyun Yun) 
(cherry picked from commit e5e492a963)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2017-05-24 18:47:31 -07:00
Amar Kamat 61ba70c978 HADOOP-7851. Configuration.getClasses() never returns the default value. (amarrk) 
(cherry picked from commit 82d57ee7fe)
 2017-05-24 17:19:54 -07:00
Konstantin V Shvachko 2b067895a1 Commit missing file TestBatchIbr for HDFS-9710 backport. 2017-05-24 12:21:48 -07:00
Konstantin V Shvachko ac1b8ff78f HDFS-9710. DN can be configured to send block receipt IBRs in batches. Contributed by Tsz-Wo Nicholas Sze. 
Backport HDFS-11837 by Vinitha Reddy Gankidi

(cherry picked from commit 5b95971f8a)
 2017-05-24 11:42:52 -07:00
Jason Lowe f99a48aa63 YARN-6615. AmIpFilter drops query parameters on redirect. Contributed by Wilfred Spiegelenburg 
(cherry picked from commit 7ef01c7c49)
 2017-05-24 11:31:39 -05:00
Konstantin V Shvachko 6d657054eb Update CHANGES.txt for HDFS-11377. 2017-05-23 15:02:30 -07:00
Brahma Reddy Battula 7ae1bc3c20 HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin. 
(cherry picked from commit 52661e0912)
 2017-05-24 00:04:25 +08:00
Brahma Reddy Battula 0b53e9f9af Update CHANGES.txt for HDFS-11849 2017-05-23 23:31:03 +08:00
Wangda Tan cf3bf3c17b Update CHANGES.txt for YARN-6493 
Change-Id: I61fbb26c4e7abb5ee4817856eb7c65f072e9d764
 2017-05-22 22:22:42 -07:00
Yiqun Lin f46781261f HDFS-11377. Balancer hung due to no available mover threads. Contributed by yunjiong zhao. 
(cherry picked from commit 9cbbd1eae8)
 2017-05-22 17:44:12 -07:00
Wangda Tan e9575d7dae YARN-6493. Print requested node partition in assignContainer logs. (Jonathan Hung via wangda) 
Change-Id: I6b045ebf0be09bcc73d4bf009ca60a59f9626916
 2017-05-22 15:04:09 -07:00
Brahma Reddy Battula cecedcf558 HDFS-11849. JournalNode startup failure exception should be logged in log file. Contributed By Surendra Singh Lilhore. 
(cherry picked from commit 9cab42cc79)
 2017-05-23 02:52:41 +08:00
Akira Ajisaka 8a0e5e3b70 HDFS-10715. NPE when applying AvailableSpaceBlockPlacementPolicy. Contributed by Guangbin Zhu. 
(cherry picked from commit ef432579a7)
(cherry picked from commit 6863866127)

# Conflicts:
#	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/AvailableSpaceBlockPlacementPolicy.java
 2017-05-21 17:47:51 -07:00
Kihwal Lee 9440ec2771 HDFS-8131. Implement a space balanced block placement policy. Contributed by Liu Shaohui. 
(cherry picked from commit de30d66b26)

# Conflicts:
#	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java
 2017-05-21 17:19:54 -07:00
Konstantin V Shvachko 321f730ca8 HDFS-9412. getBlocks occupies FSLock and takes too long to complete. Contributed by He Tianyi. Backport HDFS-11855 by Vinitha Reddy Gankidi. 
(cherry picked from commit 67523ffcf4)
(cherry picked from commit a6d0e9e56a)
 2017-05-21 13:56:44 -07:00
Xuan 43ea501e33 YARN-4612. Fix rumen and scheduler load simulator handle killed tasks 
properly. Contributed by Ming Ma.

(cherry picked from commit 4efdf3a979)
 2017-05-21 13:00:32 -07:00
Karthik Kambatla 94031b1978 YARN-4367. SLS webapp doesn't load. (kasha) 2017-05-21 11:42:38 -07:00
Varun Vasudev 6feef1b039 YARN-4302. SLS not able start due to NPE in SchedulerApplicationAttempt. Contributed by Bibin A Chundatt. 
(cherry picked from commit c28e16b40c)
 2017-05-21 11:31:23 -07:00
Konstantin V Shvachko eecc68d4d8 HDFS-9726. Refactor IBR code to a new class. Contributed by Tsz-Wo Nicholas Sze. Backport HDFS-11839 by Vinitha Reddy Gankidi. 
(cherry picked from commit 494b6c7c4b)
 2017-05-18 18:09:36 -07:00
rohithsharmaks 0a4d8f6584 YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks) 
(cherry picked from commit 8c180a13c8)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2017-05-18 17:26:30 -07:00