Commit Graph

9290 Commits

Author SHA1 Message Date
Colin Patrick Mccabe 9edea9507d HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe)
(cherry picked from commit b82567d455)
2015-05-01 11:47:28 -07:00
Arpit Agarwal aa81b86898 HDFS-8276. LazyPersistFileScrubber should be disabled if scrubber interval configured zero. (Contributed by Surendra Singh Lilhore) 2015-05-01 11:11:56 -07:00
Vinod Kumar Vavilapalli 90f6e8c90f YARN-2619. Added NodeManager support for disk io isolation through cgroups. Contributed by Varun Vasudev and Wei Yan.
(cherry picked from commit 1b3b9e5c31)
2015-04-30 21:43:22 -07:00
Jing Zhao ec7b392965 HDFS-8300. Fix unit test failures and findbugs warning caused by HDFS-8283. Contributed by Jing Zhao.
(cherry picked from commit 98a6176628)
2015-04-30 19:29:11 -07:00
Andrew Wang 34d686e6e9 HDFS-8292. Move conditional in fmt_time from dfs-dust.js to status.html. Contributed by Charles Lamb.
(cherry picked from commit 87e9978235)
2015-04-30 18:23:21 -07:00
Allen Wittenauer 4195b10860 HADOOP-11866. increase readability and reliability of checkstyle, shellcheck, and whitespace reports (aw) 2015-04-30 15:16:42 -07:00
Arun Suresh 5670b542b8 HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh)
(cherry picked from commit f0db797be2)
2015-04-30 14:02:33 -07:00
Haohui Mai 01acf3a3af HDFS-8200. Refactor FSDirStatAndListingOp. Contributed by Haohui Mai. 2015-04-30 13:41:55 -07:00
Zhijie Shen c9ee316045 YARN-3544. Got back AM logs link on the RM web UI for a completed app. Contributed by Xuan Gong.
(cherry picked from commit 21bf2cdcb77f69abc906e6cd401a8fb221f250e9)
2015-04-30 13:06:46 -07:00
Wangda Tan 100b41add6 YARN-3564. Fix TestContainerAllocation.testAMContainerAllocationWhenDNSUnavailable fails randomly. (Jian He via wangda)
(cherry picked from commit e2e8f77118)
2015-04-30 11:06:47 -07:00
Akira Ajisaka fdb886d656 HDFS-7770. Need document for storage type label of data node storage locations under dfs.data.dir. Contributed by Xiaoyu Yao.
(cherry picked from commit de9404f02f)
2015-04-30 20:13:18 +09:00
Akira Ajisaka 47ba08a119 HADOOP-11821. Fix findbugs warnings in hadoop-sls. Contributed by Brahma Reddy Battula.
(cherry picked from commit f384a063a6)
2015-04-30 19:49:32 +09:00
Akira Ajisaka 2f2d0aa990 HDFS-5574. Remove buffer copy in BlockReader.skip. Contributed by Binglin Chang.
(cherry picked from commit fd06186071bb369ee045b57a82419566e87257ec)
2015-04-30 19:11:46 +09:00
Devaraj K c3d083a9ff MAPREDUCE-6339. Job history file is not flushed correctly because
isTimerActive flag is not set true when flushTimerTask is scheduled.
Contributed by zhihai xu.

(cherry picked from commit f5b38477f9)
2015-04-30 12:36:00 +05:30
Andrew Wang 9f8412ac6e HDFS-8214. Secondary NN Web UI shows wrong date for Last Checkpoint. Contributed by Charles Lamb.
(cherry picked from commit aa22450442)
2015-04-29 17:38:09 -07:00
Jian He a7a5737bc4 YARN-3533. Test: Fix launchAM in MockRM to wait for attempt to be scheduled. Contributed by Anubhav Dhoot
(cherry picked from commit 4c1af156ae)
2015-04-29 14:51:04 -07:00
tgraves 2e13183f60 YARN-3517. RM web ui for dumping scheduler logs should be for admins only (Varun Vasudev via tgraves)
(cherry picked from commit 2e215484bd)
2015-04-29 21:27:16 +00:00
Haohui Mai 460127e6f2 HDFS-8269. getBlockLocations() does not resolve the .reserved path and generates incorrect edit logs when updating the atime. Contributed by Haohui Mai. 2015-04-29 11:12:54 -07:00
Jing Zhao ecdebb7369 HDFS-8283. DataStreamer cleanup and some minor improvement. Contributed by Tsz Wo Nicholas Sze.
(cherry picked from commit 7947e5b53b)
2015-04-29 10:43:52 -07:00
Karthik Kambatla 4cc38df7de YARN-3485. FairScheduler headroom calculation doesn't consider maxResources for Fifo and FairShare policies. (kasha)
(cherry picked from commit 8f82970e0c)
2015-04-28 21:03:12 -07:00
Haohui Mai fc9e7d7a24 HDFS-8280. Code Cleanup in DFSInputStream. Contributed by Jing Zhao. 2015-04-28 18:12:05 -07:00
Haohui Mai 7bbe9495c4 HDFS-8273. FSNamesystem#Delete() should not call logSync() when holding the lock. Contributed by Haohui Mai. 2015-04-28 18:06:08 -07:00
Jason Lowe ea828578a3 MAPREDUCE-6334. Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler. Contributed by Eric Payne
(cherry picked from commit bc1bd7e5c4)
2015-04-28 20:19:52 +00:00
Tsz-Wo Nicholas Sze 9b62a8ed77 HDFS-8204. Mover/Balancer should not schedule two replicas to the same datanode. Contributed by Walter Su 2015-04-28 13:06:30 -07:00
Allen Wittenauer d149af0539 HADOOP-11881. test-patch.sh javac result is wildly wrong (Kengo Seki via aw) 2015-04-28 10:43:43 -07:00
Devaraj K 1d03ac3533 Moving MAPREDUCE-6252 to the 2.7.1 CHANGES.txt
(cherry picked from commit 99fe03e439)
2015-04-28 12:44:07 +05:30
cnauroth a82addd614 HDFS-8232. Missing datanode counters when using Metrics2 sink interface. Contributed by Anu Engineer.
(cherry picked from commit feb68cb547)
2015-04-27 16:48:25 -07:00
Wangda Tan 8ee632caa7 YARN-2740. Fix NodeLabelsManager to properly handle node label modifications when distributed node label configuration enabled. (Naganarasimha G R via wangda)
(cherry picked from commit db1b674b50)
2015-04-27 16:42:36 -07:00
Vinod Kumar Vavilapalli 32dc13d907 MAPREDUCE-6324. Fixed MapReduce uber jobs to not fail the udpate of AM-RM tokens when they roll-over. Contributed by Jason Lowe.
(cherry picked from commit 9fc32c5c4d)
2015-04-27 14:59:57 -07:00
Karthik Kambatla d2d8bc243b Update CHANGES.txt - Pulled in YARN-3465, YARN-3516, and YARN-3464 to branch-2.7 (for 2.7.1)
(cherry picked from commit 32cd2c8d42)
2015-04-27 13:44:06 -07:00
Robert Kanter f00815ac8a HADOOP-11870. [JDK8] AuthenticationFilter, CertificateUtil, SignerSecretProviders, KeyAuthorizationKeyProvider Javadoc issues (rkanter)
(cherry picked from commit 9fec02c069)
2015-04-27 13:26:00 -07:00
Arpit Agarwal de85ff58dc HDFS-8205. Fix CHANGES.txt 2015-04-27 12:30:55 -07:00
Arpit Agarwal c254a2a671 HDFS-8205. CommandFormat#parse() should not parse option as value of option. (Contributed by Peter Shi and Xiaoyu Yao) 2015-04-27 12:25:45 -07:00
Xuan 0e8af401d7 YARN-3530. ATS throws exception on trying to filter results without
otherinfo. Contributed by zhijie shen

(cherry picked from commit 7f07c4d810)
2015-04-27 10:37:40 -07:00
Tsuyoshi Ozawa fa9def5a2a MAPREDUCE-6341. Fix typo in mapreduce tutorial. Contributed by John Michael Luy.
(cherry picked from commit 9a3dda3d34)

Conflicts:
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/site/markdown/MapReduceTutorial.md
2015-04-28 01:58:12 +09:00
Devaraj K 84ae26573c MAPREDUCE-6252. JobHistoryServer should not fail when encountering a
missing directory. Contributed by Craig Welch.

(cherry picked from commit 5e67c4d384)
2015-04-27 15:02:44 +05:30
Allen Wittenauer b73cfd7eb9 HADOOP-11357. Print information of the build enviornment in test-patch.sh (aw) 2015-04-26 15:52:48 -07:00
Karthik Kambatla 4045c41afe YARN-3464. Race condition in LocalizerRunner kills localizer before localizing all resources. (Zhihai Xu via kasha)
(cherry picked from commit 47279c3228)
2015-04-26 09:14:12 -07:00
Xiaoyu Yao 7aa3399cc5 HDFS-8206. Fix the typos in hadoop-hdfs-httpfs. (Brahma Reddy Battula via xyao) 2015-04-25 22:24:38 -07:00
cnauroth 8d256c56db HDFS-8247. TestDiskspaceQuotaUpdate#testAppendOverTypeQuota is failing. Contributed by Xiaoyu Yao.
(cherry picked from commit a00e001a1a)
2015-04-25 11:37:41 -07:00
Allen Wittenauer d6e4c10658 re-align HADOOP-11746 in CHANGES.txt between trunk and branch-2 2015-04-25 15:27:08 +01:00
Gera Shegalov fa915f73e2 MAPREDUCE-6333. TestEvents,TestAMWebServicesTasks,TestAppController are broken due to MAPREDUCE-6297. (Siqi Li via gera)
(cherry picked from commit 78c6b46241)
2015-04-24 17:38:16 -07:00
Vinod Kumar Vavilapalli db1a33e956 Moving YARN-3351, YARN-3382, YARN-3472, MAPREDUCE-6238 to the 2.7.1 CHANGES.txt
sections given the recent merge into branch-2.7.

(cherry picked from commit 2f82ae042a)
2015-04-24 17:20:02 -07:00
Jian He 9bf09b334d YARN-2498. Respect labels in preemption policy of capacity scheduler for inter-queue preemption. Contributed by Wangda Tan
(cherry picked from commit d497f6ea2b)
2015-04-24 17:03:57 -07:00
Arpit Agarwal 932cff610a HDFS-8211. DataNode UUID is always null in the JMX counter. (Contributed by Anu Engineer) 2015-04-24 16:47:56 -07:00
Tsuyoshi Ozawa 3884948d6c YARN-3406. Display count of running containers in the RM's Web UI. Contributed by Ryu Kobayashi.
(cherry picked from commit 4a3dabd94f)
2015-04-25 07:17:42 +09:00
Jason Lowe bd750f160b Fix commit version for YARN-3537
(cherry picked from commit 78fe6e57c7)
2015-04-24 22:09:01 +00:00
Jason Lowe cf4154676b YARN-3537. NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked. Contributed by Brahma Reddy Battula
(cherry picked from commit 5e093f0d40)
2015-04-24 22:04:03 +00:00
Akira Ajisaka 73ba3ebe7c YARN-3444. Fix typo capabililty. Contributed by Gabor Liptak.
(cherry picked from commit 5ce3a77f3c)
2015-04-25 06:09:03 +09:00
Ravi Prakash 122262a1fb HADOOP-11876. Refactor code to make it more readable, minor maybePrintStats bug (Zoran Dimitrijevic via raviprak) 2015-04-24 13:39:48 -07:00