Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,875 Commits 326 Branches 371 Tags
Commit Graph

8875 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
e39c58fd9d HDFS-7961. Trigger full block report after hot swapping disk. Contributed by Eddy Xu. 
(cherry picked from commit 6413d34986f3399023426c89c9a0d401c9557716)
 2015-03-24 09:07:24 -07:00
Tsuyoshi Ozawa
94eb8e5b3d MAPREDUCE-6285. ClientServiceDelegate should not retry upon AuthenticationException. Contributed by Jonathan Eagles. 
(cherry picked from commit 4170c99147b0cb6d561ff626cea140e0a061b314)
 2015-03-25 00:57:08 +09:00
Tsuyoshi Ozawa
a732b58beb HADOOP-11609. Correct credential commands info in CommandsManual.html#credential. Contributed by Varun Saxena. 
(cherry picked from commit 6e891a921e00b122390a976dfd13838472a7fcc6)
 2015-03-24 20:57:56 +09:00
Vinayakumar B
c3e2c20c99 HDFS-3325. When configuring 'dfs.namenode.safemode.threshold-pct' to a value greater or equal to 1 there is mismatch in the UI report (Contributed by J.Andreina) 
(cherry picked from commit c6c396fcd69514ba93583268b2633557c3d74a47)
 2015-03-24 12:13:21 +05:30
Harsh J
e7702ac6a1 YARN-1880. Cleanup TestApplicationClientProtocolOnHA. Contributed by ozawa. 
(cherry picked from commit 8a9bbf548dad82598354c24fcd4dc80a715da7ac)
 2015-03-24 11:58:16 +05:30
Plamen Jeliazkov
75d6d9e022 HDFS-7956. Improve logging for DatanodeRegistration. Contributed by Plamen Jeliazkov. 2015-03-23 23:07:01 -07:00
Andrew Wang
2f46ee50bd HDFS-7960. The full block report should prune zombie storages even if they're not empty. Contributed by Colin McCabe and Eddy Xu. 
(cherry picked from commit 50ee8f4e67a66aa77c5359182f61f3e951844db6)
 2015-03-23 22:00:44 -07:00
Tsz-Wo Nicholas Sze
fe693b72de HDFS-7884. Fix NullPointerException in BlockSender when the generation stamp provided by the client is larger than the one stored in the datanode. Contributed by Brahma Reddy Battula 2015-03-24 13:51:31 +09:00
Xuan
cbdcdfad6d YARN-3393. Getting application(s) goes wrong when app finishes before 
starting the attempt. Contributed by Zhijie Shen

(cherry picked from commit 9fae455e26e0230107e1c6db58a49a5b6b296cf4)
 2015-03-23 20:34:29 -07:00
cnauroth
01c0bcb176 HDFS-7917. Use file to replace data dirs in test to simulate a disk failure. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 2c238ae4e00371ef76582b007bb0e20ac8455d9c)
 2015-03-23 16:30:33 -07:00
Akira Ajisaka
fad8c78173 HDFS-7881. TestHftpFileSystem#testSeek fails in branch-2. Contributed by Brahma Reddy Battula. 2015-03-24 06:24:29 +09:00
Karthik Kambatla
4e0c48703e YARN-2868. FairScheduler: Metric for latency to allocate first container for an application. (Ray Chiang via kasha) 
(cherry picked from commit 972f1f1ab94a26ec446a272ad030fe13f03ed442)
 2015-03-23 14:10:23 -07:00
Karthik Kambatla
75591e4131 YARN-3241. FairScheduler handles invalid queue names inconsistently. (Zhihai Xu via kasha) 
(cherry picked from commit 2bc097cd14692e6ceb06bff959f28531534eb307)
 2015-03-23 13:24:22 -07:00
cnauroth
342c525eaa YARN-3336. FileSystem memory leak in DelegationTokenRenewer. 
(cherry picked from commit 6ca1f12024fd7cec7b01df0f039ca59f3f365dc1)
 2015-03-23 10:46:06 -07:00
Devaraj K
943d9ee603 MAPREDUCE-6242. Progress report log is incredibly excessive in application 
master. Contributed by Varun Saxena.
 2015-03-23 22:48:00 +05:30
Brandon Li
503d8e4164 HDFS-7942. NFS: support regexp grouping in nfs.exports.allowed.hosts. Contributed by Brandon Li 
(cherry picked from commit 36af4a913c97113bd0486c48e1cb864c5cba46fd)
 2015-03-23 10:09:43 -07:00
Tsuyoshi Ozawa
cbacf20755 YARN-3384. TestLogAggregationService.verifyContainerLogs fails after YARN-2777. Contributed by Naganarasimha G R. 
(cherry picked from commit 82eda771e05cf2b31788ee1582551e65f1c0f9aa)
 2015-03-24 00:25:52 +09:00
Tsuyoshi Ozawa
4fee662944 HADOOP-11737. mockito's version in hadoop-nfs’ pom.xml shouldn't be specified. Contributed by Kengo Seki. 
(cherry picked from commit 0b9f12c847e26103bc2304cf7114e6d103264669)
 2015-03-23 13:56:38 +09:00
Harsh J
2cd2431289 MAPREDUCE-6287. Deprecated methods in org.apache.hadoop.examples.Sort. Contributed by Chao Zhang. 
(cherry picked from commit b375d1fc936913edf4a75212559f160c41043906)
 2015-03-23 03:48:55 +05:30
Harsh J
6e6e0e4a37 MAPREDUCE-5448. Addendum fix to remove deprecation warning by junit.Assert import in TestFileOutputCommitter. 
(cherry picked from commit 4cd54d9a297435150ab61803284eb05603f114e2)
 2015-03-22 10:33:29 +05:30
Harsh J
40682a4aad MAPREDUCE-6286. Amend commit to CHANGES.txt for backport into 2.7.0. 
(cherry picked from commit 8770c82acc948bc5127afb1c59072718fd04630c)
 2015-03-22 10:16:12 +05:30
Harsh J
d43c0da7d7 MAPREDUCE-5190. Unnecessary condition test in RandomSampler. Contributed by Jingguo Yao. 
(cherry picked from commit 1d5c796d654c8959972d15cc6742731a99380bfc)
 2015-03-22 10:04:19 +05:30
Harsh J
a7f1c1b993 MAPREDUCE-5448. MapFileOutputFormat#getReaders bug with invisible files/folders. Contributed by Maysam Yabandeh. 
(cherry picked from commit b46c2bb51ae524e6640756620f70e5925cda7592)
 2015-03-22 09:46:54 +05:30
Harsh J
7c72c7f529 MAPREDUCE-6286. A typo in HistoryViewer makes some code useless, which causes counter limits are not reset correctly. Contributed by Zhihai Xu. 
(cherry picked from commit 433542904aba5ddebf9bd9d299378647351eb13a)
 2015-03-22 02:51:17 +05:30
Harsh J
418d078bc5 MAPREDUCE-6213. NullPointerException caused by job history server addr not resolvable. Contributed by Peng Zhang. 
(cherry picked from commit e1e09052e861926112493d6041aae01ab594b547)
 2015-03-22 02:45:01 +05:30
Harsh J
97da36777f MAPREDUCE-6239. Consolidate TestJobConf classes in hadoop-mapreduce-client-jobclient and hadoop-mapreduce-client-core. Contributed by Varun Saxena. 2015-03-22 02:20:11 +05:30
Jian He
9c494cedaf YARN-3345. Add non-exclusive node label API. Contributed by Wangda Tan 
(cherry picked from commit e1feb4ea1a532d680d6ca69b55ffcae1552d64f0)
 2015-03-20 19:05:14 -07:00
Junping Du
9aedb3d688 YARN-3350. YARN RackResolver spams logs with messages at info level. Contributed by Wilfred Spiegelenburg 
(cherry picked from commit 7f1e2f996995e1883d9336f720c27621cf1b73b6)
 2015-03-20 18:22:23 -07:00
Karthik Kambatla
3672ae8a7a HADOOP-11447. Add a more meaningful toString method to SampleStat and MutableStat. (kasha) 
(cherry picked from commit fe5c23b670c773145b87fecfaf9191536e9f1c51)
 2015-03-20 17:05:40 -07:00
Jian He
a3a155a34e YARN-3356. Capacity Scheduler FiCaSchedulerApp should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan 
(cherry picked from commit 586348e4cbf197188057d6b843a6701cfffdaff3)
 2015-03-20 13:54:46 -07:00
Junping Du
f40f17489c YARN-3269. Yarn.nodemanager.remote-app-log-dir could not be configured to fully qualified path. Contributed by Xuan Gong 
(cherry picked from commit d81109e588493cef31e68508a3d671203bd23e12)
 2015-03-20 13:42:31 -07:00
Robert Kanter
308460654a MAPREDUCE-6282. Reuse historyFileAbsolute.getFileSystem in CompletedJob#loadFullHistoryData for code optimization. (zxu via rkanter) 
(cherry picked from commit d4f7e2507f4bb024444d172f94e74431bc2f319c)
 2015-03-20 13:12:34 -07:00
Kihwal Lee
29642b33cb HDFS-6841. Use Time.monotonicNow() wherever applicable instead of Time.now(). Contributed by Vinayakumar B 
(cherry picked from commit 99a8dcd19528b265d4fda9ae09a17e4af52f2782)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/DatanodeInfo.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
 2015-03-20 14:05:02 -05:00
Jing Zhao
6be52e42a9 HDFS-7957. Truncate should verify quota before making changes. Contributed by Jing Zhao. 
(cherry picked from commit d368d3647a858644b9fcd3be33d9fea2a6962f69)
 2015-03-20 11:54:35 -07:00
Jing Zhao
a3e16f414c HDFS-7829. Code clean up for LocatedBlock. Contributed by Takanobu Asanuma. 
(cherry picked from commit a6a5aae472d015d2ea5cd746719485dff93873a8)
 2015-03-20 10:51:06 -07:00
Wangda Tan
8e142d27cb YARN-3369. Missing NullPointer check in AppSchedulingInfo causes RM to die. (Brahma Reddy Battula via wangda) 
(cherry picked from commit 6bc7710ec7f2592c4c87dd940fbe5827ef81fe72)
 2015-03-20 10:42:51 -07:00
Xuan
7990e1d80d YARN-2777. Mark the end of individual log in aggregated log. Contributed 
by Varun Saxena

(cherry picked from commit 1a4b52869191b7e39c0101d3585efc12d6362c1c)
 2015-03-20 10:25:26 -07:00
Yongjun Zhang
0a41b1bdca HDFS-7835. make initial sleeptime in locateFollowingBlock configurable for DFSClient. Contributed by Zhihai Xu. 
(cherry-picked from commit 15612313f578a5115f8d03885e9b0c8c376ed56e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java
 2015-03-20 09:25:59 -07:00
Tsuyoshi Ozawa
ed7f847c95 HADOOP-11709. Time.NANOSECONDS_PER_MILLISECOND - use class-level final constant instead of method variable. Contributed by Ajith S. 
(cherry picked from commit 43dde502b3be2133d62f1f074f016f35a56a7e2c)
 2015-03-21 00:54:39 +09:00
yliu
3fac95f48d HDFS-7962. Remove duplicated logs in BlockManager. (yliu) 2015-03-20 05:31:08 +08:00
Jian He
3f0c9e5fe3 YARN-3379. Fixed missing data in localityTable and ResourceRequests table in RM WebUI. Contributed by Xuan Gong 
(cherry picked from commit 4e886eb9cbd2dcb128bbfd17309c734083093a4c)
 2015-03-19 22:27:57 -07:00
yliu
90164ffd84 HDFS-7930. commitBlockSynchronization() does not remove locations. (yliu) 2015-03-19 23:24:55 +08:00
Jason Lowe
cabe676d67 MAPREDUCE-6275. Race condition in FileOutputCommitter v2 for user-specified task output subdirs. Contributed by Gera Shegalov and Siqi Li 
(cherry picked from commit 91baca145a6c16fe13f455d150c05bd73179531b)
 2015-03-19 21:40:51 +00:00
Kihwal Lee
2b9173059d HDFS-7932. Speed up the shutdown of datanode during rolling upgrade. Contributed by Kihwal Lee. 
(cherry picked from commit 61a4c7fc9891def0e85edf7e41d74c6b92c85fdb)
 2015-03-19 12:28:36 -05:00
Tsuyoshi Ozawa
ef9aa7c34b MAPREDUCE-6281. Fix javadoc in Terasort. Contributed by Albert Chu. 
(cherry picked from commit 1ccbc29708f7e89b9292a861df3bc3b8f4f7febe)
 2015-03-20 00:59:43 +09:00
Tsuyoshi Ozawa
0eeb760c55 HADOOP-11729. Fix link to cgroups doc in site.xml. Contributed by Masatake Iwasaki. 
(cherry picked from commit 522c897146aa4e9588d3c25639750c8ed712ef9e)
 2015-03-19 23:08:41 +09:00
Vinayakumar B
786ba9784d HDFS.7849. Update documentation for enabling a new feature in rolling upgrade ( Contributed by J.Andreina ) 
(cherry picked from commit 5be5129d93481e9caae6a05b2361c463211a6d55)
 2015-03-19 19:06:47 +05:30
Kihwal Lee
ceb39c1cc6 HDFS-7816. Unable to open webhdfs paths with "+". Contributed by Haohui Mai 
(cherry picked from commit e79be0ee123d05104eb34eb854afcf9fa78baef2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-03-19 08:03:47 -05:00
Devaraj K
a888dac344 YARN-3357. Move TestFifoScheduler to FIFO package. Contributed by Rohith 
Sharmaks.

(cherry picked from commit 93d0f4acc8454b7a460da8883fbd14f14a575370)
 2015-03-19 12:18:08 +05:30
Vinayakumar B
25515d1421 HDFS-7867. Update action param from 'start' to 'prepare' in rolling upgrade ( Contributed by J.Andreina) Updated JIRA id. 
(cherry picked from commit 355e008ffbb0a33cb7d5782fc291abd62d684aaa)
 2015-03-19 12:11:34 +05:30