Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,657 Commits 326 Branches 371 Tags
Commit Graph

10657 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Wangda Tan
6eefae1b33 YARN-4510. Fix SLS startup failure caused by NPE. (Bibin A Chundatt via wangda) 2015-12-30 15:34:39 -08:00
Wangda Tan
9a7d5f69ec YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda) 
(cherry picked from commit 8310b2e9ff3d6804bad703c4c15458b0dfeeb4af)
 2015-12-30 15:31:11 -08:00
Xiaoyu Yao
a65e159c59 HADOOP-12608. Fix exception message in WASB when connecting with anonymous credential. Contributed by Dushyanth. 
(cherry picked from commit 007a8decc61750720033e06b6d08861ac3788e41)
 2015-12-30 11:12:02 -08:00
Xiaoyu Yao
d590c17851 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit ab725cff66e8a047e9437e42ac49ac8685ee7a94)
 2015-12-30 10:43:44 -08:00
Junping Du
401d1e6e8a YARN-1382. Remove unusableRMNodesConcurrentSet (never used) in NodeListManager to get rid of memory leak. Contributed by Rohith Sharma K S. 
(cherry picked from commit 223ce323bb81463ec5c5ac7316738370d4a47366)
 2015-12-30 07:53:08 -08:00
Jian He
970bb2da15 YARN-4098. Document ApplicationPriority feature. Contributed by Rohith Sharma K S 2015-12-29 16:52:14 -08:00
Jian He
3661d4907a YARN-3480. Remove attempts that are beyond max-attempt limit from state store. Contributed by Jun Gong 
(cherry picked from commit 52734134116eb4b18686e308d00e71e7e903383e)
 2015-12-29 15:59:42 -08:00
Wangda Tan
3efbde5378 YARN-4315. NaN in Queue percentage for cluster apps page. (Bibin A Chundatt via wangda) 
(cherry picked from commit 561abb9fee5f57f74c2b5868a065b818678622fa)
 2015-12-29 13:29:19 -08:00
cnauroth
1f8162b74e HDFS-7553. fix the TestDFSUpgradeWithHA due to BindException. Contributed by Xiao Chen. 2015-12-29 10:57:24 -08:00
Akira Ajisaka
a8314505d0 MAPREDUCE-6589. TestTaskLog outputs a log under directory other than target/test-dir. (aajisaka) 
(cherry picked from commit 2a59d01503ed547bac15443fc273b5e04a2839d9)
 2015-12-30 01:34:15 +09:00
Akira Ajisaka
1a06949126 MAPREDUCE-6584. Remove trailing whitespaces from mapred-default.xml. (aajisaka) 2015-12-30 01:04:11 +09:00
Jian He
c7cc9d6bac YARN-4417. Make RM and Timeline-server REST APIs more consistent. Contributed by Wangda Tan 
(cherry picked from commit d0a22bae9bd2c701c9d80896934fe07388cf5ae0)
 2015-12-28 15:54:14 -08:00
Wangda Tan
ca575e6add MAPREDUCE-6574. MR AM should print host of failed tasks. (Mohammad Shahid Khan via wangda) 
(cherry picked from commit 32b3dc11eba8f2d8f22ca502bf30d6aa8839460e)
 2015-12-28 11:04:30 -08:00
Xiaoyu Yao
c664062fb3 HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang. 
(cherry picked from commit 993311e547e6dd7757025d5ffc285019bd4fc1f6)
 2015-12-28 10:42:15 -08:00
Akira Ajisaka
babe025fb0 HADOOP-12681. start-build-env.sh fails in branch-2. Contributed by Kengo Seki. 2015-12-28 14:38:56 +09:00
Benoy Antony
42160d358a HDFS-9597. BaseReplicationPolicyTest should update data node stats after adding a data node. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 8cfd672397efd91c471c417afef3aff85f64b506)
 2015-12-25 08:57:34 -08:00
Gera Shegalov
8baf9369bb YARN-2934. Improve handling of container's stderr. (Naganarasimha G R via gera) 
(cherry picked from commit 2c17b81569c05b5f375d0ddad99d43cb4e3b23b1)
 2015-12-24 23:52:43 -08:00
Tsuyoshi Ozawa
c6e0f64582 YARN-4234. addendum patch to remove unnecessary file. Contributed by Masatake Iwasaki. 
(cherry picked from commit 65537845a9799c6a73eecccb4cd437def58459d8)
 2015-12-24 19:54:05 +09:00
Rohith Sharma K S
2d0348c907 MAPREDUCE-6419. JobHistoryServer doesn't sort properly based on Job ID when Job id's exceed 9999. (Mohammad Shahid Khan via rohithsharmaks) 
(cherry picked from commit a308e86621b1a7692fe1004ed14c919fdaba03cd)
 2015-12-24 12:00:37 +05:30
Karthik Kambatla
2f67645475 YARN-4156. TestAMRestart#testAMBlacklistPreventsRestartOnSameNode assumes CapacityScheduler. (Anubhav Dhoot via kasha) 
(cherry picked from commit 0af492b4bdb0356ea04e13690b78a236b82bd40c)
 2015-12-23 17:52:54 -08:00
Karthik Kambatla
a98887d8b5 HADOOP-12566. Add NullGroupMapping. (Daniel Templeton via kasha) 
(cherry picked from commit 8b1837fcd1f01d881deacd72b4e548ec2bdcb7ad)
 2015-12-23 14:38:24 -08:00
Junping Du
dbc4c79b44 YARN-4400. AsyncDispatcher.waitForDrained should be final. Contributed by Daniel Templeton. 
(cherry picked from commit bb5df272b9c0be9830ee8480cd33e75d26deb9d1)
 2015-12-23 08:55:55 -08:00
Junping Du
6e97a3c968 YARN-4234. New put APIs in TimelineClient for ats v1.5. Contributed by Xuan Gong. 
(cherry picked from commit 882f2f04644a13cadb93070d5545f7a4f8691fde)
 2015-12-23 05:27:47 -08:00
rohithsharmaks
08ddb536eb YARN-4109. Exception on RM scheduler page loading with labels. (Mohammad Shahid Khan via rohithsharmaks) 
(cherry picked from commit 8c180a13c82ab9d60f595e6942e35d51024dab53)
 2015-12-23 09:16:58 +05:30
Benoy Antony
0d249a5e28 HDFS-9034. StorageTypeStats Metric should not count failed storage. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit df83230948204ee2d2b06ecc66ce0163e2df27ef)
 2015-12-22 15:29:36 -08:00
Kihwal Lee
131260f0a7 HDFS-7163. WebHdfsFileSystem should retry reads according to the configured retry policy. Contributed by Eric Payne. 
(cherry picked from commit 867048c3e4b20ece0039a876def129fa5eb9234f)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFS.java
 2015-12-22 14:19:12 -06:00
cnauroth
9b039a5004 HDFS-9458. TestBackupNode always binds to port 50070, which can cause bind failures. Contributed by Xiao Chen. 
(cherry picked from commit 5c0ff69618fa303078c0f9afef4c93a864ab6cb7)
 2015-12-22 10:29:40 -08:00
Colin Patrick Mccabe
a56c5ef636 HDFS-9589. Block files which have been hardlinked should be duplicated before the DataNode appends to the them (cmccabe) 
(cherry picked from commit bb540ba85aa37d9fe31e640665158afe8a936230)
 2015-12-22 09:37:30 -08:00
Arun Suresh
31893468b1 YARN-4477. FairScheduler: Handle condition which can result in an infinite loop in attemptScheduling. (Tao Jie via asuresh) 
(cherry picked from commit e88422df45550f788ae8dd73aec84bde28012aeb)
 2015-12-21 22:41:49 -08:00
cnauroth
fdfcffb3d1 YARN-3458. CPU resource monitoring in Windows. Contributed by Inigo Goiri. 
(cherry picked from commit 114b59095540bb80db5153c816f9d285e4029031)
 2015-12-21 16:59:17 -08:00
Wangda Tan
daf5fae369 YARN-4290. Add -showDetails option to YARN Nodes CLI to print all nodes reports information. (Sunil G via wangda) 
(cherry picked from commit a0de7028515eebe1c526cc42808cdbc8ed6b4e2a)
 2015-12-21 11:36:49 -08:00
Wangda Tan
f16daa59a4 YARN-4454. NM to nodelabel mapping going wrong after RM restart. (Bibin A Chundatt via wangda) 
(cherry picked from commit bc038b382cb2ce561ce718405fbcee4382f3b204)
 2015-12-21 11:30:37 -08:00
Akira Ajisaka
12caea3274 Move HDFS-8914 from 2.8.0 to 2.7.3 in CHANGES.txt. 
(cherry picked from commit 2cb5afffc4c546e3d0d0f68a921905967047b0e0)
 2015-12-21 21:53:44 +09:00
Akira Ajisaka
7526a2a005 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki. 
(cherry picked from commit fa544020f6f71ee993f047c9b986c047a25ed84c)
 2015-12-21 21:23:28 +09:00
Akira Ajisaka
8607cb6074 MAPREDUCE-6583. Clarify confusing sentence in MapReduce tutorial document. Contributed by Kai Sasaki. 
(cherry picked from commit 7995a6ea4dc524e5b17606359d09df72d771224a)
 2015-12-21 00:16:39 +09:00
Uma Mahesh
fc9e130825 YARN-4480. Clean up some inappropriate imports. (Kai Zheng via umamahesh) 
(cherry picked from commit 0f82b5d878a76b1626c9e07b2fbb55ce2a79232a)
 2015-12-19 23:17:33 -08:00
Chris Douglas
d984ba4fd7 HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri 
(cherry picked from commit 8652cce5b21825f6f835e4ea31de82eb59fb06c1)
 2015-12-18 18:31:20 -08:00
cnauroth
dd91cf9fa5 HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal. 
(cherry picked from commit 932956458dddabd9583b911c693386a56d723c0d)
 2015-12-18 16:25:06 -08:00
Arpit Agarwal
e0a40b2dc2 HADOOP-12656. MiniKdc throws "address in use" BindException. (Contributed by Wei-Chiu Chuang) 2015-12-18 16:06:12 -08:00
Zhe Zhang
223b47b398 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
 2015-12-18 16:05:21 -08:00
Jian He
1147b086d9 YARN-4164. Changed updateApplicationPriority API to return the updated application priority. Contributed by Rohith Sharma K S 2015-12-18 14:14:31 -08:00
Colin Patrick Mccabe
31d2fb91fc HDFS-9350. Avoid creating temprorary strings in Block.toString() and getBlockName() (Staffan Friberg via cmccabe) 
(cherry picked from commit e63388fdf22b5fd20ca00f9fad9f40656f117d95)
 2015-12-18 10:05:12 -08:00
Andrew Wang
71fb205735 HDFS-8477. describe dfs.ha.zkfc.port in hdfs-default.xml. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 058cfddebbbbdad367bafbd13485df70b4cc50c8)
 2015-12-18 09:14:23 -08:00
Vinayakumar B
c887bcd1f0 HDFS-9393. After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy (Contributed by J.Andreina) 
(cherry picked from commit bfadf11b36e9d97e03d6ed1e71829907c2301412)
 2015-12-18 11:39:46 +05:30
Akira Ajisaka
af49823499 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 061c05cc05ff6257b14c5c4f25cbcec2d184cda7)
 2015-12-18 14:00:07 +09:00
Akira Ajisaka
e06c291245 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki. 
(cherry picked from commit bd5e207432c54cc75fd8c040e232241678987e53)
 2015-12-18 13:12:56 +09:00
cnauroth
7e5306e795 HDFS-9571. Fix ASF Licence warnings in Jenkins reports. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 6da9deec204a4fa69dfc2d891ce934979d59b0ab)
 2015-12-17 16:26:08 -08:00
Kihwal Lee
3c0ae5914c HDFS-9533. seen_txid in the shared edits directory is modified during bootstrapping. Contributed by Kihwal Lee. 
(cherry picked from commit 5cb1e0118b173a95c1f7bdfae1e58d7833d61c26)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/BootstrapStandby.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestBootstrapStandby.java
 2015-12-17 17:23:06 -06:00
Junping Du
6d2914a697 YARN-3226. UI changes for decommissioning node. Contributed by Sunil G. 
(cherry picked from commit 1de56b0448d332717c8316c621b4f6af542a85cc)
 2015-12-17 15:21:42 -08:00
cnauroth
294d0f6f6a HDFS-9572. Prevent DataNode log spam if a client connects on the data transfer port but sends no data. Contributed by Chris Nauroth 
(cherry picked from commit 03bab8dea163a9ee45d09d2a0483d45cf6fe57c9)
 2015-12-17 14:05:05 -08:00