Commit Graph

9729 Commits

Author SHA1 Message Date
Arpit Agarwal 95e71772cf HDFS-7192. DN should ignore lazyPersist hint if the writer is not local. (Contributed by Arpit Agarwal) 2015-07-30 13:16:52 -07:00
Wangda Tan 53a0653826 YARN-3971. Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery. (Bibin A Chundatt via wangda)
(cherry picked from commit 91b42e7d6e)
2015-07-30 10:01:01 -07:00
Wangda Tan a28e23d049 YARN-3963. AddNodeLabel on duplicate label addition shows success. (Bibin A Chundatt via wangda)
(cherry picked from commit 8acb30b016)
2015-07-30 09:43:45 -07:00
Haohui Mai 3faf7bc3fe HDFS-8816. Improve visualization for the Datanode tab in the NN UI. Contributed by Haohui Mai. 2015-07-29 17:14:20 -07:00
rohithsharmaks 9c00ae0009 YARN-3919. NPEs' while stopping service after exception during CommonNodeLabelsManager#start. (varun saxena via rohithsharmaks) 2015-07-29 23:44:15 +05:30
Karthik Kambatla 8659315062 YARN-2768. Avoid cloning Resource in FSAppAttempt#updateDemand. (Hong Zhiguo via kasha)
(cherry picked from commit 5205a330b3)
2015-07-29 09:42:57 -07:00
Jason Lowe e6b4714d0b HADOOP-10945. 4-digit octal umask permissions throws a parse error. Contributed by Chang Li
(cherry picked from commit 6f0a35724f)
2015-07-29 15:25:59 +00:00
Jason Lowe 6f50a6a456 YARN-3950. Add unique SHELL_ID environment variable to DistributedShell. Contributed by Robert Kanter
(cherry picked from commit 2b2bd92146)
2015-07-29 15:18:45 +00:00
Vinayakumar B a0238d85f6 HDFS-8670. Better to exclude decommissioned nodes for namenode NodeUsage JMX (Contributed by J.Andreina)
(cherry picked from commit 6374ee0db4)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-07-29 14:49:16 +05:30
Akira Ajisaka dff49aee08 Revert "HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)"
This reverts commit 17319c4a65.
2015-07-29 16:52:54 +09:00
Lei Xu 9d81916040 HDFS-8834. TestReplication is not valid after HDFS-6482. (Contributed by Lei Xu)
(cherry picked from commit f4f1b8b267)
2015-07-28 23:41:44 -07:00
Vinayakumar B dcf1f1fdf8 HDFS-8822. Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies (Contributed by Vinayakumar B)
(cherry picked from commit 975e138df3)
2015-07-29 11:51:18 +05:30
Vinayakumar B 0c09597942 HDFS-8811. Move BlockStoragePolicy name's constants from HdfsServerConstants.java to HdfsConstants.java (Contributed by Vinayakumar B)
(cherry picked from commit 50887e5b07)
2015-07-29 11:46:19 +05:30
Jakob Homan 71a5aa267d HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak.
(cherry picked from commit 0712a8103f)
2015-07-28 21:11:02 -07:00
Colin Patrick Mccabe 5875935669 HADOOP-12175. FsShell must load SpanReceierHost to support tracing (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 69b095730b)
2015-07-28 12:56:36 -07:00
Xuan 2ec008eb38 YARN-3982. container-executor parsing of container-executor.cfg broken
in trunk and branch-2. Contributed by Varun Vasudev

(cherry picked from commit f170934215)
2015-07-27 23:47:31 -07:00
Arun Suresh ffe6a34d5b HDFS-7858. Improve HA Namenode Failover detection on the client. (asuresh)
(cherry picked from commit 030fcfa99c)
2015-07-27 23:03:34 -07:00
Akira Ajisaka c650ab0037 HADOOP-12245. References to misspelled REMAINING_QUATA in FileSystemShell.md. Contributed by Gabor Liptak.
(cherry picked from commit e21dde501a)
2015-07-28 11:34:16 +09:00
Jian He 7c123accda YARN-3846. RM Web UI queue filter is not working for sub queue. Contributed by Mohammad Shahid Khan
(cherry picked from commit 3572ebd738)
2015-07-27 17:12:24 -07:00
Varun Vasudev 9da487e0fd YARN-3853. Add docker container runtime support to LinuxContainterExecutor. Contributed by Sidharta Seethana.
(cherry picked from commit 3e6fce91a4)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/LinuxContainerExecutor.java
2015-07-27 12:03:36 -07:00
Varun Vasudev ec0f801f52 YARN-3852. Add docker container support to container-executor. Contributed by Abin Shahab.
(cherry picked from commit f36835ff9b)
2015-07-27 10:18:06 -07:00
Akira Ajisaka 1cf5e40838 HDFS-8810. Correct assertions in TestDFSInotifyEventInputStream class. Contributed by Surendra Singh Lilhore.
(cherry picked from commit 1df78688c6)
2015-07-27 13:18:02 +09:00
Akira Ajisaka 0e7c88347e YARN-3958. TestYarnConfigurationFields should be moved to hadoop-yarn-api module. Contributed by Varun Saxena.
(cherry picked from commit 42d4e0ae99)
2015-07-27 11:45:41 +09:00
ccurino 26ea045814 YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino)
(cherry picked from commit 156f24ead0)
2015-07-25 07:47:11 -07:00
Allen Wittenauer 621203bf44 HADOOP-12237. releasedocmaker.py doesn't work behind a proxy (Tsuyoshi Ozawa via aw)
(cherry picked from commit b41fe3111a)
(cherry picked from commit adcf5dd940)
2015-07-24 18:32:18 -07:00
Allen Wittenauer f54862ff15 HADOOP-12202. releasedocmaker drops missing component and assignee entries (aw)
(cherry picked from commit adbacf7010)
(cherry picked from commit d7697831e3)
2015-07-24 18:32:13 -07:00
Allen Wittenauer a6cad7d856 HADOOP-12135. cleanup releasedocmaker
(cherry picked from commit 3fee9f8d18)
(cherry picked from commit e8b62d11d4)
2015-07-24 18:32:10 -07:00
Allen Wittenauer cf348f2eb8 HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw)
(cherry picked from commit 8e657fba2f)
(cherry picked from commit 098ba450cc)
2015-07-24 18:32:05 -07:00
Wangda Tan 4ba2e1ae95 YARN-3973. Recent changes to application priority management break reservation system from YARN-1051 (Carlo Curino via wangda)
(cherry picked from commit a3bd7b4a59)
2015-07-24 16:45:06 -07:00
Jason Lowe 2cf714123a YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu
(cherry picked from commit ff9c13e0a7)
2015-07-24 22:15:44 +00:00
Jian He 3233284e87 YARN-3026. Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp. Contributed by Wangda Tan
(cherry picked from commit 83fe34ac08)
2015-07-24 14:01:36 -07:00
carlo curino bddc48ed86 YARN-3969. Updating CHANGES.txt to reflect the correct set of branches where this is committed
(cherry picked from commit fc42fa8ae3)
2015-07-24 13:40:14 -07:00
Colin Patrick Mccabe 2419711369 HADOOP-12170. hadoop-common's JNIFlags.cmake is redundant and can be removed (Alan Burlison via Colin P. McCabe)
(cherry picked from commit e4b0c74434)
2015-07-24 13:23:51 -07:00
Allen Wittenauer fed9f767b1 HADOOP-11813. releasedocmaker.py should use today's date instead of unreleased (Darrell Taylor via aw)
(cherry picked from commit f325522c14)
2015-07-24 11:55:57 -07:00
Allen Wittenauer 2a0688fdb8 HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw)
(cherry picked from commit 8d3c0f601d)
2015-07-24 11:55:56 -07:00
Karthik Kambatla d2ee02940a YARN-3957. FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500. (Anubhav Dhoot via kasha)
(cherry picked from commit d19d187753)
2015-07-24 11:49:46 -07:00
Akira Ajisaka 7bdd32ce3c HDFS-8735. Inotify: All events classes should implement toString() API. Contributed by Surendra Singh Lilhore.
(cherry picked from commit f8f6091823)
2015-07-25 02:57:33 +09:00
Xuan 98ed4bca3b YARN-3967. Fetch the application report from the AHS if the RM does not
know about it. Contributed by Mit Desai

(cherry picked from commit fbd6063269)
2015-07-24 10:17:05 -07:00
Robert Kanter 731ed9cad8 HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter)
(cherry picked from commit ee233ec95c)
2015-07-24 09:42:04 -07:00
carlo curino 6a71a0a230 YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)
(cherry picked from commit 0fcb4a8cf2)
2015-07-23 19:36:54 -07:00
Akira Ajisaka b2a532f61c HDFS-8806. Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared. Contributed by Zhe Zhang.
(cherry picked from commit 206d4933a5)
2015-07-24 18:29:24 +09:00
Rohith Sharma K S 9d15860e6d YARN-3845. Scheduler page does not render RGBA color combinations in IE11. (Contributed by Mohammad Shahid Khan) 2015-07-24 12:54:07 +05:30
Akira Ajisaka 17319c4a65 HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)
(cherry picked from commit 02c01815ec)
2015-07-24 11:39:16 +09:00
Robert Kanter ba3b40ae79 YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter)
(cherry picked from commit 1d3026e7b3)
2015-07-23 14:47:28 -07:00
Andrew Wang cf258b6d98 HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. Contributed by Zhihai Xu.
(cherry picked from commit 6736a1ab70)
2015-07-23 14:42:44 -07:00
Allen Wittenauer a37285620d HADOOP-11731. Rework the changelog and releasenotes (aw)
(cherry picked from commit f383fd9b6c)

 Conflicts:
	hadoop-project/src/site/site.xml
2015-07-23 14:08:10 -07:00
Haohui Mai d3e6b40b44 HDFS-8730. Clean up the import statements in ClientProtocol. Contributed by Takanobu Asanuma. 2015-07-23 10:30:43 -07:00
Arpit Agarwal 601b503895 HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. (Contributed by Brahma Reddy Battula) 2015-07-23 10:14:01 -07:00
Wangda Tan 6baebcaedc YARN-3941. Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler. (Sunil G via wangda)
(cherry picked from commit 3bba180051)
2015-07-23 10:08:30 -07:00
Jing Zhao 71764a92c6 HDFS-8797. WebHdfsFileSystem creates too many connections for pread. Contributed by Jing Zhao.
(cherry picked from commit e91ccfad07)
2015-07-22 18:03:45 -07:00