Commit Graph

10607 Commits

Author SHA1 Message Date
Wangda Tan 6eefae1b33 YARN-4510. Fix SLS startup failure caused by NPE. (Bibin A Chundatt via wangda) 2015-12-30 15:34:39 -08:00
Wangda Tan 9a7d5f69ec YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda)
(cherry picked from commit 8310b2e9ff)
2015-12-30 15:31:11 -08:00
Xiaoyu Yao a65e159c59 HADOOP-12608. Fix exception message in WASB when connecting with anonymous credential. Contributed by Dushyanth.
(cherry picked from commit 007a8decc61750720033e06b6d08861ac3788e41)
2015-12-30 11:12:02 -08:00
Xiaoyu Yao d590c17851 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang.
(cherry picked from commit ab725cff66)
2015-12-30 10:43:44 -08:00
Junping Du 401d1e6e8a YARN-1382. Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak. Contributed by Rohith Sharma K S.
(cherry picked from commit 223ce323bb)
2015-12-30 07:53:08 -08:00
Jian He 970bb2da15 YARN-4098. Document ApplicationPriority feature. Contributed by Rohith Sharma K S 2015-12-29 16:52:14 -08:00
Jian He 3661d4907a YARN-3480. Remove attempts that are beyond max-attempt limit from state store. Contributed by Jun Gong
(cherry picked from commit 5273413411)
2015-12-29 15:59:42 -08:00
Wangda Tan 3efbde5378 YARN-4315. NaN in Queue percentage for cluster apps page. (Bibin A Chundatt via wangda)
(cherry picked from commit 561abb9fee)
2015-12-29 13:29:19 -08:00
cnauroth 1f8162b74e HDFS-7553. fix the TestDFSUpgradeWithHA due to BindException. Contributed by Xiao Chen. 2015-12-29 10:57:24 -08:00
Akira Ajisaka a8314505d0 MAPREDUCE-6589. TestTaskLog outputs a log under directory other than target/test-dir. (aajisaka)
(cherry picked from commit 2a59d01503)
2015-12-30 01:34:15 +09:00
Akira Ajisaka 1a06949126 MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. (aajisaka) 2015-12-30 01:04:11 +09:00
Jian He c7cc9d6bac YARN-4417. Make RM and Timeline-server REST APIs more consistent. Contributed by Wangda Tan
(cherry picked from commit d0a22bae9b)
2015-12-28 15:54:14 -08:00
Wangda Tan ca575e6add MAPREDUCE-6574. MR AM should print host of failed tasks. (Mohammad Shahid Khan via wangda)
(cherry picked from commit 32b3dc11eb)
2015-12-28 11:04:30 -08:00
Xiaoyu Yao c664062fb3 HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang.
(cherry picked from commit 993311e547)
2015-12-28 10:42:15 -08:00
Akira Ajisaka babe025fb0 HADOOP-12681. start-build-env.sh fails in branch-2. Contributed by Kengo Seki. 2015-12-28 14:38:56 +09:00
Benoy Antony 42160d358a HDFS-9597. BaseReplicationPolicyTest should update data node stats after adding a data node. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 8cfd672397)
2015-12-25 08:57:34 -08:00
Gera Shegalov 8baf9369bb YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera)
(cherry picked from commit 2c17b81569)
2015-12-24 23:52:43 -08:00
Tsuyoshi Ozawa c6e0f64582 YARN-4234. addendum patch to remove unnecessary file. Contributed by Masatake Iwasaki.
(cherry picked from commit 65537845a9)
2015-12-24 19:54:05 +09:00
Rohith Sharma K S 2d0348c907 MAPREDUCE-6419. JobHistoryServer doesn't sort properly based on Job ID when Job id's exceed 9999. (Mohammad Shahid Khan via rohithsharmaks)
(cherry picked from commit a308e86621)
2015-12-24 12:00:37 +05:30
Karthik Kambatla 2f67645475 YARN-4156. TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler. (Anubhav Dhoot via kasha)
(cherry picked from commit 0af492b4bd)
2015-12-23 17:52:54 -08:00
Karthik Kambatla a98887d8b5 HADOOP-12566. Add NullGroupMapping. (Daniel Templeton via kasha)
(cherry picked from commit 8b1837fcd1)
2015-12-23 14:38:24 -08:00
Junping Du dbc4c79b44 YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton.
(cherry picked from commit bb5df272b9)
2015-12-23 08:55:55 -08:00
Junping Du 6e97a3c968 YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong.
(cherry picked from commit 882f2f0464)
2015-12-23 05:27:47 -08:00
rohithsharmaks 08ddb536eb YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks)
(cherry picked from commit 8c180a13c8)
2015-12-23 09:16:58 +05:30
Benoy Antony 0d249a5e28 HDFS-9034. StorageTypeStats Metric should not count failed storage. Contributed by Surendra Singh Lilhore.
(cherry picked from commit df83230948)
2015-12-22 15:29:36 -08:00
Kihwal Lee 131260f0a7 HDFS-7163. WebHdfsFileSystem should retry reads according to the configured retry policy. Contributed by Eric Payne.
(cherry picked from commit 867048c3e4)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
2015-12-22 14:19:12 -06:00
cnauroth 9b039a5004 HDFS-9458. TestBackupNode always binds to port 50070, which can cause bind failures. Contributed by Xiao Chen.
(cherry picked from commit 5c0ff69618)
2015-12-22 10:29:40 -08:00
Colin Patrick Mccabe a56c5ef636 HDFS-9589. Block files which have been hardlinked should be duplicated before the DataNode appends to the them (cmccabe)
(cherry picked from commit bb540ba85a)
2015-12-22 09:37:30 -08:00
Arun Suresh 31893468b1 YARN-4477. FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. (Tao Jie via asuresh)
(cherry picked from commit e88422df45)
2015-12-21 22:41:49 -08:00
cnauroth fdfcffb3d1 YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri.
(cherry picked from commit 114b590955)
2015-12-21 16:59:17 -08:00
Wangda Tan daf5fae369 YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes reports information. (Sunil G via wangda)
(cherry picked from commit a0de702851)
2015-12-21 11:36:49 -08:00
Wangda Tan f16daa59a4 YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda)
(cherry picked from commit bc038b382c)
2015-12-21 11:30:37 -08:00
Akira Ajisaka 12caea3274 Move HDFS-8914 from 2.8.0 to 2.7.3 in CHANGES.txt.
(cherry picked from commit 2cb5afffc4)
2015-12-21 21:53:44 +09:00
Akira Ajisaka 7526a2a005 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki.
(cherry picked from commit fa544020f6)
2015-12-21 21:23:28 +09:00
Akira Ajisaka 8607cb6074 MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki.
(cherry picked from commit 7995a6ea4d)
2015-12-21 00:16:39 +09:00
Uma Mahesh fc9e130825 YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh)
(cherry picked from commit 0f82b5d878)
2015-12-19 23:17:33 -08:00
Chris Douglas d984ba4fd7 HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri
(cherry picked from commit 8652cce5b2)
2015-12-18 18:31:20 -08:00
cnauroth dd91cf9fa5 HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal.
(cherry picked from commit 932956458d)
2015-12-18 16:25:06 -08:00
Arpit Agarwal e0a40b2dc2 HADOOP-12656. MiniKdc throws "address in use" BindException. (Contributed by Wei-Chiu Chuang) 2015-12-18 16:06:12 -08:00
Zhe Zhang 223b47b398 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang.
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
2015-12-18 16:05:21 -08:00
Jian He 1147b086d9 YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S 2015-12-18 14:14:31 -08:00
Colin Patrick Mccabe 31d2fb91fc HDFS-9350. Avoid creating temprorary strings in Block.toString() and getBlockName() (Staffan Friberg via cmccabe)
(cherry picked from commit e63388fdf2)
2015-12-18 10:05:12 -08:00
Andrew Wang 71fb205735 HDFS-8477. describe dfs.ha.zkfc.port in hdfs-default.xml. Contributed by Kanaka Kumar Avvaru.
(cherry picked from commit 058cfddebb)
2015-12-18 09:14:23 -08:00
Vinayakumar B c887bcd1f0 HDFS-9393. After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy (Contributed by J.Andreina)
(cherry picked from commit bfadf11b36)
2015-12-18 11:39:46 +05:30
Akira Ajisaka af49823499 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru.
(cherry picked from commit 061c05cc05)
2015-12-18 14:00:07 +09:00
Akira Ajisaka e06c291245 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki.
(cherry picked from commit bd5e207432)
2015-12-18 13:12:56 +09:00
cnauroth 7e5306e795 HDFS-9571. Fix ASF Licence warnings in Jenkins reports. Contributed by Brahma Reddy Battula.
(cherry picked from commit 6da9deec20)
2015-12-17 16:26:08 -08:00
Kihwal Lee 3c0ae5914c HDFS-9533. seen_txid in the shared edits directory is modified during bootstrapping. Contributed by Kihwal Lee.
(cherry picked from commit 5cb1e0118b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/BootstrapStandby.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestBootstrapStandby.java
2015-12-17 17:23:06 -06:00
Junping Du 6d2914a697 YARN-3226. UI changes for decommissioning node. Contributed by Sunil G.
(cherry picked from commit 1de56b0448)
2015-12-17 15:21:42 -08:00
cnauroth 294d0f6f6a HDFS-9572. Prevent DataNode log spam if a client connects on the data transfer port but sends no data. Contributed by Chris Nauroth
(cherry picked from commit 03bab8dea1)
2015-12-17 14:05:05 -08:00