Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,030 Commits 326 Branches 371 Tags
Commit Graph

9030 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Akira Ajisaka
fdb886d656 HDFS-7770. Need document for storage type label of data node storage locations under dfs.data.dir. Contributed by Xiaoyu Yao. 
(cherry picked from commit de9404f02f36bf9a1100c67f41db907d494bb9ed)
 2015-04-30 20:13:18 +09:00
Akira Ajisaka
47ba08a119 HADOOP-11821. Fix findbugs warnings in hadoop-sls. Contributed by Brahma Reddy Battula. 
(cherry picked from commit f384a063a653b33d69f7d2c7d4fd45c24b5aa46a)
 2015-04-30 19:49:32 +09:00
Akira Ajisaka
2f2d0aa990 HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 
(cherry picked from commit fd06186071bb369ee045b57a82419566e87257ec)
 2015-04-30 19:11:46 +09:00
Devaraj K
c3d083a9ff MAPREDUCE-6339. Job history file is not flushed correctly because 
isTimerActive flag is not set true when flushTimerTask is scheduled.
Contributed by zhihai xu.

(cherry picked from commit f5b38477f9d0827b238fadd260c1dd2889531fd4)
 2015-04-30 12:36:00 +05:30
Andrew Wang
9f8412ac6e HDFS-8214. Secondary NN Web UI shows wrong date for Last Checkpoint. Contributed by Charles Lamb. 
(cherry picked from commit aa22450442ebe39916a6fd460fe97e347945526d)
 2015-04-29 17:38:09 -07:00
Jian He
a7a5737bc4 YARN-3533. Test: Fix launchAM in MockRM to wait for attempt to be scheduled. Contributed by Anubhav Dhoot 
(cherry picked from commit 4c1af156aef4f3bb1d9823d5980c59b12007dc77)
 2015-04-29 14:51:04 -07:00
tgraves
2e13183f60 YARN-3517. RM web ui for dumping scheduler logs should be for admins only (Varun Vasudev via tgraves) 
(cherry picked from commit 2e215484bd05cd5e3b7a81d3558c6879a05dd2d2)
 2015-04-29 21:27:16 +00:00
Haohui Mai
460127e6f2 HDFS-8269. getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime. Contributed by Haohui Mai. 2015-04-29 11:12:54 -07:00
Jing Zhao
ecdebb7369 HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 7947e5b53b9ac9524b535b0384c1c355b74723ff)
 2015-04-29 10:43:52 -07:00
Karthik Kambatla
4cc38df7de YARN-3485. FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies. (kasha) 
(cherry picked from commit 8f82970e0c247b37b2bf33aa21f6a39afa07efde)
 2015-04-28 21:03:12 -07:00
Haohui Mai
fc9e7d7a24 HDFS-8280. Code Cleanup in DFSInputStream. Contributed by Jing Zhao. 2015-04-28 18:12:05 -07:00
Haohui Mai
7bbe9495c4 HDFS-8273. FSNamesystem#Delete() should not call logSync() when holding the lock. Contributed by Haohui Mai. 2015-04-28 18:06:08 -07:00
Jason Lowe
ea828578a3 MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler. Contributed by Eric Payne 
(cherry picked from commit bc1bd7e5c4047b374420683d36a8c30eda6d75b6)
 2015-04-28 20:19:52 +00:00
Tsz-Wo Nicholas Sze
9b62a8ed77 HDFS-8204. Mover/Balancer should not schedule two replicas to the same datanode. Contributed by Walter Su 2015-04-28 13:06:30 -07:00
Allen Wittenauer
d149af0539 HADOOP-11881. test-patch.sh javac result is wildly wrong (Kengo Seki via aw) 2015-04-28 10:43:43 -07:00
Devaraj K
1d03ac3533 Moving MAPREDUCE-6252 to the 2.7.1 CHANGES.txt 
(cherry picked from commit 99fe03e439b0f9afd01754d998c6eb64f0f70300)
 2015-04-28 12:44:07 +05:30
cnauroth
a82addd614 HDFS-8232. Missing datanode counters when using Metrics2 sink interface. Contributed by Anu Engineer. 
(cherry picked from commit feb68cb5470dc3e6c16b6bc1549141613e360601)
 2015-04-27 16:48:25 -07:00
Wangda Tan
8ee632caa7 YARN-2740. Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled. (Naganarasimha G R via wangda) 
(cherry picked from commit db1b674b50ddecf2774f4092d677c412722bdcb1)
 2015-04-27 16:42:36 -07:00
Vinod Kumar Vavilapalli
32dc13d907 MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they roll-over. Contributed by Jason Lowe. 
(cherry picked from commit 9fc32c5c4d1d5f50c605bdb0e3b13f44c86660c8)
 2015-04-27 14:59:57 -07:00
Karthik Kambatla
d2d8bc243b Update CHANGES.txt - Pulled in YARN-3465, YARN-3516, and YARN-3464 to branch-2.7 (for 2.7.1) 
(cherry picked from commit 32cd2c8d429ddb87348299c00b7d851246a25b4e)
 2015-04-27 13:44:06 -07:00
Robert Kanter
f00815ac8a HADOOP-11870. [JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues (rkanter) 
(cherry picked from commit 9fec02c069f9bb24b5ee99031917075b4c7a7682)
 2015-04-27 13:26:00 -07:00
Arpit Agarwal
de85ff58dc HDFS-8205. Fix CHANGES.txt 2015-04-27 12:30:55 -07:00
Arpit Agarwal
c254a2a671 HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:25:45 -07:00
Xuan
0e8af401d7 YARN-3530. ATS throws exception on trying to filter results without 
otherinfo. Contributed by zhijie shen

(cherry picked from commit 7f07c4d81023e3bf4bf8980e64cc9420ec31cf55)
 2015-04-27 10:37:40 -07:00
Tsuyoshi Ozawa
fa9def5a2a MAPREDUCE-6341. Fix typo in mapreduce tutorial. Contributed by John Michael Luy. 
(cherry picked from commit 9a3dda3d345b94cf6f9062c00395500596829cf1)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapReduceTutorial.md
 2015-04-28 01:58:12 +09:00
Devaraj K
84ae26573c MAPREDUCE-6252. JobHistoryServer should not fail when encountering a 
missing directory. Contributed by Craig Welch.

(cherry picked from commit 5e67c4d384193b38a85655c8f93193596821faa5)
 2015-04-27 15:02:44 +05:30
Allen Wittenauer
b73cfd7eb9 HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) 2015-04-26 15:52:48 -07:00
Karthik Kambatla
4045c41afe YARN-3464. Race condition in LocalizerRunner kills localizer before localizing all resources. (Zhihai Xu via kasha) 
(cherry picked from commit 47279c3228185548ed09c36579b420225e4894f5)
 2015-04-26 09:14:12 -07:00
Xiaoyu Yao
7aa3399cc5 HDFS-8206. Fix the typos in hadoop-hdfs-httpfs. (Brahma Reddy Battula via xyao) 2015-04-25 22:24:38 -07:00
cnauroth
8d256c56db HDFS-8247. TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing. Contributed by Xiaoyu Yao. 
(cherry picked from commit a00e001a1a9fa2c6287b2f078e425e9bb157e5ca)
 2015-04-25 11:37:41 -07:00
Allen Wittenauer
d6e4c10658 re-align HADOOP-11746 in CHANGES.txt between trunk and branch-2 2015-04-25 15:27:08 +01:00
Gera Shegalov
fa915f73e2 MAPREDUCE-6333. TestEvents,TestAMWebServicesTasks,TestAppController are broken due to MAPREDUCE-6297. (Siqi Li via gera) 
(cherry picked from commit 78c6b462412bbadad4a1a13ed4c597927b0cf188)
 2015-04-24 17:38:16 -07:00
Vinod Kumar Vavilapalli
db1a33e956 Moving YARN-3351, YARN-3382, YARN-3472, MAPREDUCE-6238 to the 2.7.1 CHANGES.txt 
sections given the recent merge into branch-2.7.

(cherry picked from commit 2f82ae042a6f3110742aaa57c076bb9ebd7888d1)
 2015-04-24 17:20:02 -07:00
Jian He
9bf09b334d YARN-2498. Respect labels in preemption policy of capacity scheduler for inter-queue preemption. Contributed by Wangda Tan 
(cherry picked from commit d497f6ea2be559aa31ed76f37ae949dbfabe2a51)
 2015-04-24 17:03:57 -07:00
Arpit Agarwal
932cff610a HDFS-8211. DataNode UUID is always null in the JMX counter. (Contributed by Anu Engineer) 2015-04-24 16:47:56 -07:00
Tsuyoshi Ozawa
3884948d6c YARN-3406. Display count of running containers in the RM's Web UI. Contributed by Ryu Kobayashi. 
(cherry picked from commit 4a3dabd94fc3dddd9d7604b826065c23859d565f)
 2015-04-25 07:17:42 +09:00
Jason Lowe
bd750f160b Fix commit version for YARN-3537 
(cherry picked from commit 78fe6e57c7697dae192d74e2f5b91040a3579dfd)
 2015-04-24 22:09:01 +00:00
Jason Lowe
cf4154676b YARN-3537. NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked. Contributed by Brahma Reddy Battula 
(cherry picked from commit 5e093f0d400f82f67d9b2d24253c79e4a5abacf9)
 2015-04-24 22:04:03 +00:00
Akira Ajisaka
73ba3ebe7c YARN-3444. Fix typo capabililty. Contributed by Gabor Liptak. 
(cherry picked from commit 5ce3a77f3c00aeabcd791c3373dd3c8c25160ce2)
 2015-04-25 06:09:03 +09:00
Ravi Prakash
122262a1fb HADOOP-11876. Refactor code to make it more readable, minor maybePrintStats bug (Zoran Dimitrijevic via raviprak) 2015-04-24 13:39:48 -07:00
cnauroth
524593ee84 HADOOP-11843. Make setting up the build environment easier. Contributed by Niels Basjes. 
(cherry picked from commit 80935268f5fdd358070c6b68f89e8bd699785c54)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-04-24 13:08:47 -07:00
Jian He
0583c27fb1 YARN-3387. Previous AM's container completed status couldn't pass to current AM if AM and RM restarted during the same time. Contributed by Sandflee 
(cherry picked from commit d03dcb9635dbd79a45d229d1cab5fd28e5e49f49)
 2015-04-24 12:14:17 -07:00
Andrew Wang
89a15d6074 HDFS-8191. Fix byte to integer casting in SimulatedFSDataset#simulatedByte. Contributed by Zhe Zhang. 
(cherry picked from commit c7d9ad68e34c7f8b9efada6cfbf7d5474cbeff11)
 2015-04-24 11:54:48 -07:00
Jing Zhao
5870d504e1 HDFS-8176. Record from/to snapshots in audit log for snapshot diff report. Contributed by J. Andreina. 
(cherry picked from commit cf6c8a1b4ee70dd45c2e42ac61999e61a05db035)
 2015-04-24 10:24:12 -07:00
Xuan
c184466939 YARN-3511. Add errors and warnings page to ATS. Contributed by Varun Vasudev 
(cherry picked from commit eee9facbbae52cb62dfca01b8bbe676b8e289863)
 2015-04-24 09:43:35 -07:00
Vinayakumar B
2ec356fcdb HDFS-8231. StackTrace displayed at client while QuotaByStorageType exceeds (Contributed by J.Andreina and Xiaoyu Yao) 
(cherry picked from commit c8d72907ff5a4cb9ce1effca8ad9b69689d11d1d)
 2015-04-24 12:51:56 +05:30
Vinayakumar B
68063cac3e HDFS-8217. During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. (Contributed by Vinayakumar B) 
(cherry picked from commit 262c1bc3398ce2ede03f9d86fc97c35ca7a8e9db)
 2015-04-24 12:18:04 +05:30
Colin Patrick Mccabe
3d0385c3c8 HDFS-8070. Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode (cmccabe) 
(cherry picked from commit a8898445dc9b5cdb7230e2e23a57393c9f378ff0)
 2015-04-23 19:15:33 -07:00
Colin Patrick Mccabe
788b76761d HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) 
(cherry picked from commit a0e0a63209b5eb17dca5cc503be36aa52defeabd)
 2015-04-23 19:08:20 -07:00
Haohui Mai
b64bb2b9b4 HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:44:21 -07:00