Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,030 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

9030 Commits

Author SHA1 Message Date
Akira Ajisaka fdb886d656 HDFS-7770. Need document for storage type label of data node storage locations under dfs.data.dir. Contributed by Xiaoyu Yao. 
(cherry picked from commit de9404f02f)
 2015-04-30 20:13:18 +09:00
Akira Ajisaka 47ba08a119 HADOOP-11821. Fix findbugs warnings in hadoop-sls. Contributed by Brahma Reddy Battula. 
(cherry picked from commit f384a063a6)
 2015-04-30 19:49:32 +09:00
Akira Ajisaka 2f2d0aa990 HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang. 
(cherry picked from commit fd06186071bb369ee045b57a82419566e87257ec)
 2015-04-30 19:11:46 +09:00
Devaraj K c3d083a9ff MAPREDUCE-6339. Job history file is not flushed correctly because 
isTimerActive flag is not set true when flushTimerTask is scheduled.
Contributed by zhihai xu.

(cherry picked from commit f5b38477f9)
 2015-04-30 12:36:00 +05:30
Andrew Wang 9f8412ac6e HDFS-8214. Secondary NN Web UI shows wrong date for Last Checkpoint. Contributed by Charles Lamb. 
(cherry picked from commit aa22450442)
 2015-04-29 17:38:09 -07:00
Jian He a7a5737bc4 YARN-3533. Test: Fix launchAM in MockRM to wait for attempt to be scheduled. Contributed by Anubhav Dhoot 
(cherry picked from commit 4c1af156ae)
 2015-04-29 14:51:04 -07:00
tgraves 2e13183f60 YARN-3517. RM web ui for dumping scheduler logs should be for admins only (Varun Vasudev via tgraves) 
(cherry picked from commit 2e215484bd)
 2015-04-29 21:27:16 +00:00
Haohui Mai 460127e6f2 HDFS-8269. getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime. Contributed by Haohui Mai. 2015-04-29 11:12:54 -07:00
Jing Zhao ecdebb7369 HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 7947e5b53b)
 2015-04-29 10:43:52 -07:00
Karthik Kambatla 4cc38df7de YARN-3485. FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies. (kasha) 
(cherry picked from commit 8f82970e0c)
 2015-04-28 21:03:12 -07:00
Haohui Mai fc9e7d7a24 HDFS-8280. Code Cleanup in DFSInputStream. Contributed by Jing Zhao. 2015-04-28 18:12:05 -07:00
Haohui Mai 7bbe9495c4 HDFS-8273. FSNamesystem#Delete() should not call logSync() when holding the lock. Contributed by Haohui Mai. 2015-04-28 18:06:08 -07:00
Jason Lowe ea828578a3 MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler. Contributed by Eric Payne 
(cherry picked from commit bc1bd7e5c4)
 2015-04-28 20:19:52 +00:00
Tsz-Wo Nicholas Sze 9b62a8ed77 HDFS-8204. Mover/Balancer should not schedule two replicas to the same datanode. Contributed by Walter Su 2015-04-28 13:06:30 -07:00
Allen Wittenauer d149af0539 HADOOP-11881. test-patch.sh javac result is wildly wrong (Kengo Seki via aw) 2015-04-28 10:43:43 -07:00
Devaraj K 1d03ac3533 Moving MAPREDUCE-6252 to the 2.7.1 CHANGES.txt 
(cherry picked from commit 99fe03e439)
 2015-04-28 12:44:07 +05:30
cnauroth a82addd614 HDFS-8232. Missing datanode counters when using Metrics2 sink interface. Contributed by Anu Engineer. 
(cherry picked from commit feb68cb547)
 2015-04-27 16:48:25 -07:00
Wangda Tan 8ee632caa7 YARN-2740. Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled. (Naganarasimha G R via wangda) 
(cherry picked from commit db1b674b50)
 2015-04-27 16:42:36 -07:00
Vinod Kumar Vavilapalli 32dc13d907 MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they roll-over. Contributed by Jason Lowe. 
(cherry picked from commit 9fc32c5c4d)
 2015-04-27 14:59:57 -07:00
Karthik Kambatla d2d8bc243b Update CHANGES.txt - Pulled in YARN-3465, YARN-3516, and YARN-3464 to branch-2.7 (for 2.7.1) 
(cherry picked from commit 32cd2c8d42)
 2015-04-27 13:44:06 -07:00
Robert Kanter f00815ac8a HADOOP-11870. [JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues (rkanter) 
(cherry picked from commit 9fec02c069)
 2015-04-27 13:26:00 -07:00
Arpit Agarwal de85ff58dc HDFS-8205. Fix CHANGES.txt 2015-04-27 12:30:55 -07:00
Arpit Agarwal c254a2a671 HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:25:45 -07:00
Xuan 0e8af401d7 YARN-3530. ATS throws exception on trying to filter results without 
otherinfo. Contributed by zhijie shen

(cherry picked from commit 7f07c4d810)
 2015-04-27 10:37:40 -07:00
Tsuyoshi Ozawa fa9def5a2a MAPREDUCE-6341. Fix typo in mapreduce tutorial. Contributed by John Michael Luy. 
(cherry picked from commit 9a3dda3d34)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapReduceTutorial.md
 2015-04-28 01:58:12 +09:00
Devaraj K 84ae26573c MAPREDUCE-6252. JobHistoryServer should not fail when encountering a 
missing directory. Contributed by Craig Welch.

(cherry picked from commit 5e67c4d384)
 2015-04-27 15:02:44 +05:30
Allen Wittenauer b73cfd7eb9 HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) 2015-04-26 15:52:48 -07:00
Karthik Kambatla 4045c41afe YARN-3464. Race condition in LocalizerRunner kills localizer before localizing all resources. (Zhihai Xu via kasha) 
(cherry picked from commit 47279c3228)
 2015-04-26 09:14:12 -07:00
Xiaoyu Yao 7aa3399cc5 HDFS-8206. Fix the typos in hadoop-hdfs-httpfs. (Brahma Reddy Battula via xyao) 2015-04-25 22:24:38 -07:00
cnauroth 8d256c56db HDFS-8247. TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing. Contributed by Xiaoyu Yao. 
(cherry picked from commit a00e001a1a)
 2015-04-25 11:37:41 -07:00
Allen Wittenauer d6e4c10658 re-align HADOOP-11746 in CHANGES.txt between trunk and branch-2 2015-04-25 15:27:08 +01:00
Gera Shegalov fa915f73e2 MAPREDUCE-6333. TestEvents,TestAMWebServicesTasks,TestAppController are broken due to MAPREDUCE-6297. (Siqi Li via gera) 
(cherry picked from commit 78c6b46241)
 2015-04-24 17:38:16 -07:00
Vinod Kumar Vavilapalli db1a33e956 Moving YARN-3351, YARN-3382, YARN-3472, MAPREDUCE-6238 to the 2.7.1 CHANGES.txt 
sections given the recent merge into branch-2.7.

(cherry picked from commit 2f82ae042a)
 2015-04-24 17:20:02 -07:00
Jian He 9bf09b334d YARN-2498. Respect labels in preemption policy of capacity scheduler for inter-queue preemption. Contributed by Wangda Tan 
(cherry picked from commit d497f6ea2b)
 2015-04-24 17:03:57 -07:00
Arpit Agarwal 932cff610a HDFS-8211. DataNode UUID is always null in the JMX counter. (Contributed by Anu Engineer) 2015-04-24 16:47:56 -07:00
Tsuyoshi Ozawa 3884948d6c YARN-3406. Display count of running containers in the RM's Web UI. Contributed by Ryu Kobayashi. 
(cherry picked from commit 4a3dabd94f)
 2015-04-25 07:17:42 +09:00
Jason Lowe bd750f160b Fix commit version for YARN-3537 
(cherry picked from commit 78fe6e57c7)
 2015-04-24 22:09:01 +00:00
Jason Lowe cf4154676b YARN-3537. NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked. Contributed by Brahma Reddy Battula 
(cherry picked from commit 5e093f0d40)
 2015-04-24 22:04:03 +00:00
Akira Ajisaka 73ba3ebe7c YARN-3444. Fix typo capabililty. Contributed by Gabor Liptak. 
(cherry picked from commit 5ce3a77f3c)
 2015-04-25 06:09:03 +09:00
Ravi Prakash 122262a1fb HADOOP-11876. Refactor code to make it more readable, minor maybePrintStats bug (Zoran Dimitrijevic via raviprak) 2015-04-24 13:39:48 -07:00
cnauroth 524593ee84 HADOOP-11843. Make setting up the build environment easier. Contributed by Niels Basjes. 
(cherry picked from commit 80935268f5)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-04-24 13:08:47 -07:00
Jian He 0583c27fb1 YARN-3387. Previous AM's container completed status couldn't pass to current AM if AM and RM restarted during the same time. Contributed by Sandflee 
(cherry picked from commit d03dcb9635)
 2015-04-24 12:14:17 -07:00
Andrew Wang 89a15d6074 HDFS-8191. Fix byte to integer casting in SimulatedFSDataset#simulatedByte. Contributed by Zhe Zhang. 
(cherry picked from commit c7d9ad68e3)
 2015-04-24 11:54:48 -07:00
Jing Zhao 5870d504e1 HDFS-8176. Record from/to snapshots in audit log for snapshot diff report. Contributed by J. Andreina. 
(cherry picked from commit cf6c8a1b4e)
 2015-04-24 10:24:12 -07:00
Xuan c184466939 YARN-3511. Add errors and warnings page to ATS. Contributed by Varun Vasudev 
(cherry picked from commit eee9facbba)
 2015-04-24 09:43:35 -07:00
Vinayakumar B 2ec356fcdb HDFS-8231. StackTrace displayed at client while QuotaByStorageType exceeds (Contributed by J.Andreina and Xiaoyu Yao) 
(cherry picked from commit c8d72907ff)
 2015-04-24 12:51:56 +05:30
Vinayakumar B 68063cac3e HDFS-8217. During block recovery for truncate Log new Block Id in case of copy-on-truncate is true. (Contributed by Vinayakumar B) 
(cherry picked from commit 262c1bc339)
 2015-04-24 12:18:04 +05:30
Colin Patrick Mccabe 3d0385c3c8 HDFS-8070. Pre-HDFS-7915 DFSClient cannot use short circuit on post-HDFS-7915 DataNode (cmccabe) 
(cherry picked from commit a8898445dc)
 2015-04-23 19:15:33 -07:00
Colin Patrick Mccabe 788b76761d HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe) 
(cherry picked from commit a0e0a63209)
 2015-04-23 19:08:20 -07:00
Haohui Mai b64bb2b9b4 HDFS-8052. Move WebHdfsFileSystem into hadoop-hdfs-client. Contributed by Haohui Mai. 2015-04-23 17:44:21 -07:00