Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,672 Commits 326 Branches 371 Tags
Commit Graph

9672 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Lowe
6f50a6a456 YARN-3950. Add unique SHELL_ID environment variable to DistributedShell. Contributed by Robert Kanter 
(cherry picked from commit 2b2bd9214604bc2e14e41e08d30bf86f512151bd)
 2015-07-29 15:18:45 +00:00
Vinayakumar B
a0238d85f6 HDFS-8670. Better to exclude decommissioned nodes for namenode NodeUsage JMX (Contributed by J.Andreina) 
(cherry picked from commit 6374ee0db445e0a1c3462c19ddee345df740cfb3)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-07-29 14:49:16 +05:30
Akira Ajisaka
dff49aee08 Revert "HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka)" 
This reverts commit 17319c4a659dd150ccfe80da81fbaee69ca8ef1e.
 2015-07-29 16:52:54 +09:00
Lei Xu
9d81916040 HDFS-8834. TestReplication is not valid after HDFS-6482. (Contributed by Lei Xu) 
(cherry picked from commit f4f1b8b267703b8bebab06e17e69a4a4de611592)
 2015-07-28 23:41:44 -07:00
Vinayakumar B
dcf1f1fdf8 HDFS-8822. Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies (Contributed by Vinayakumar B) 
(cherry picked from commit 975e138df316f59e8bb0642e138d4b1170fb8184)
 2015-07-29 11:51:18 +05:30
Vinayakumar B
0c09597942 HDFS-8811. Move BlockStoragePolicy name's constants from HdfsServerConstants.java to HdfsConstants.java (Contributed by Vinayakumar B) 
(cherry picked from commit 50887e5b07b6abb20c0edd74211e5612dc7b16da)
 2015-07-29 11:46:19 +05:30
Jakob Homan
71a5aa267d HDFS-8180. AbstractFileSystem Implementation for WebHdfs. Contributed by Sathosh G Nayak. 
(cherry picked from commit 0712a8103fec6e9a9ceba335e3c3800b85b2c7ca)
 2015-07-28 21:11:02 -07:00
Colin Patrick Mccabe
5875935669 HADOOP-12175. FsShell must load SpanReceierHost to support tracing (Masatake Iwasaki via Colin P. McCabe) 
(cherry picked from commit 69b095730bd87706ddcbabeea6c513290ee4cdf5)
 2015-07-28 12:56:36 -07:00
Xuan
2ec008eb38 YARN-3982. container-executor parsing of container-executor.cfg broken 
in trunk and branch-2. Contributed by Varun Vasudev

(cherry picked from commit f17093421521efcbdc813f6f2b8411e45ecc7863)
 2015-07-27 23:47:31 -07:00
Arun Suresh
ffe6a34d5b HDFS-7858. Improve HA Namenode Failover detection on the client. (asuresh) 
(cherry picked from commit 030fcfa99c345ad57625486eeabedebf2fd4411f)
 2015-07-27 23:03:34 -07:00
Akira Ajisaka
c650ab0037 HADOOP-12245. References to misspelled REMAINING_QUATA in FileSystemShell.md. Contributed by Gabor Liptak. 
(cherry picked from commit e21dde501aa9323b7f34b4bc4ba9d282ec4f2707)
 2015-07-28 11:34:16 +09:00
Jian He
7c123accda YARN-3846. RM Web UI queue filter is not working for sub queue. Contributed by Mohammad Shahid Khan 
(cherry picked from commit 3572ebd738aa5fa8b0906d75fb12cc6cbb991573)
 2015-07-27 17:12:24 -07:00
Varun Vasudev
9da487e0fd YARN-3853. Add docker container runtime support to LinuxContainterExecutor. Contributed by Sidharta Seethana. 
(cherry picked from commit 3e6fce91a471b4a5099de109582e7c6417e8a822)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/LinuxContainerExecutor.java
 2015-07-27 12:03:36 -07:00
Varun Vasudev
ec0f801f52 YARN-3852. Add docker container support to container-executor. Contributed by Abin Shahab. 
(cherry picked from commit f36835ff9b878fa20fe58a30f9d1e8c47702d6d2)
 2015-07-27 10:18:06 -07:00
Akira Ajisaka
1cf5e40838 HDFS-8810. Correct assertions in TestDFSInotifyEventInputStream class. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 1df78688c69476f89d16f93bc74a4f05d0b1a3da)
 2015-07-27 13:18:02 +09:00
Akira Ajisaka
0e7c88347e YARN-3958. TestYarnConfigurationFields should be moved to hadoop-yarn-api module. Contributed by Varun Saxena. 
(cherry picked from commit 42d4e0ae99d162fde52902cb86e29f2c82a084c8)
 2015-07-27 11:45:41 +09:00
ccurino
26ea045814 YARN-3656. LowCost: A Cost-Based Placement Agent for YARN Reservations. (Jonathan Yaniv and Ishai Menache via curino) 
(cherry picked from commit 156f24ead00436faad5d4aeef327a546392cd265)
 2015-07-25 07:47:11 -07:00
Allen Wittenauer
621203bf44 HADOOP-12237. releasedocmaker.py doesn't work behind a proxy (Tsuyoshi Ozawa via aw) 
(cherry picked from commit b41fe3111ae37478cbace2a07e6ac35a676ef978)
(cherry picked from commit adcf5dd94052481f66deaf402ac4ace1ffc06f49)
 2015-07-24 18:32:18 -07:00
Allen Wittenauer
f54862ff15 HADOOP-12202. releasedocmaker drops missing component and assignee entries (aw) 
(cherry picked from commit adbacf7010373dbe6df239688b4cebd4a93a69e4)
(cherry picked from commit d7697831e3b24bec149990feed819e7d96f78184)
 2015-07-24 18:32:13 -07:00
Allen Wittenauer
a6cad7d856 HADOOP-12135. cleanup releasedocmaker 
(cherry picked from commit 3fee9f8d18dd60d83da674b3cfbefe666915fad8)
(cherry picked from commit e8b62d11d460e9706e48df92a0b0a72f4a02d3f5)
 2015-07-24 18:32:10 -07:00
Allen Wittenauer
cf348f2eb8 HADOOP-11807. add a lint mode to releasedocmaker (ramtin via aw) 
(cherry picked from commit 8e657fba2fd33f7550597ea9c4c6e9a87aa1ef1c)
(cherry picked from commit 098ba450cc98475b84d60bb5ac3bd7b558b2a67c)
 2015-07-24 18:32:05 -07:00
Wangda Tan
4ba2e1ae95 YARN-3973. Recent changes to application priority management break reservation system from YARN-1051 (Carlo Curino via wangda) 
(cherry picked from commit a3bd7b4a59b3664273dc424f240356838213d4e7)
 2015-07-24 16:45:06 -07:00
Jason Lowe
2cf714123a YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu 
(cherry picked from commit ff9c13e0a739bb13115167dc661b6a16b2ed2c04)
 2015-07-24 22:15:44 +00:00
Jian He
3233284e87 YARN-3026. Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp. Contributed by Wangda Tan 
(cherry picked from commit 83fe34ac0896cee0918bbfad7bd51231e4aec39b)
 2015-07-24 14:01:36 -07:00
carlo curino
bddc48ed86 YARN-3969. Updating CHANGES.txt to reflect the correct set of branches where this is committed 
(cherry picked from commit fc42fa8ae3bc9d6d055090a7bb5e6f0c5972fcff)
 2015-07-24 13:40:14 -07:00
Colin Patrick Mccabe
2419711369 HADOOP-12170. hadoop-common's JNIFlags.cmake is redundant and can be removed (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit e4b0c74434b82c25256a59b03d62b1a66bb8ac69)
 2015-07-24 13:23:51 -07:00
Allen Wittenauer
fed9f767b1 HADOOP-11813. releasedocmaker.py should use today's date instead of unreleased (Darrell Taylor via aw) 
(cherry picked from commit f325522c1423f89dced999a16d49a004b2879743)
 2015-07-24 11:55:57 -07:00
Allen Wittenauer
2a0688fdb8 HADOOP-11797. releasedocmaker.py needs to put ASF headers on output (aw) 
(cherry picked from commit 8d3c0f601d549a22648050bcc9a0e4acf37edc81)
 2015-07-24 11:55:56 -07:00
Karthik Kambatla
d2ee02940a YARN-3957. FairScheduler NPE In FairSchedulerQueueInfo causing scheduler page to return 500. (Anubhav Dhoot via kasha) 
(cherry picked from commit d19d18775368f5aaa254881165acc1299837072b)
 2015-07-24 11:49:46 -07:00
Akira Ajisaka
7bdd32ce3c HDFS-8735. Inotify: All events classes should implement toString() API. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit f8f60918230dd466ae8dda1fbc28878e19273232)
 2015-07-25 02:57:33 +09:00
Xuan
98ed4bca3b YARN-3967. Fetch the application report from the AHS if the RM does not 
know about it. Contributed by Mit Desai

(cherry picked from commit fbd6063269221ec25834684477f434e19f0b66af)
 2015-07-24 10:17:05 -07:00
Robert Kanter
731ed9cad8 HADOOP-12259. Utility to Dynamic port allocation (brahmareddy via rkanter) 
(cherry picked from commit ee233ec95ce8cfc8309d3adc072d926cd85eba08)
 2015-07-24 09:42:04 -07:00
carlo curino
6a71a0a230 YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino) 
(cherry picked from commit 0fcb4a8cf2add3f112907ff4e833e2f04947b53e)
 2015-07-23 19:36:54 -07:00
Akira Ajisaka
b2a532f61c HDFS-8806. Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared. Contributed by Zhe Zhang. 
(cherry picked from commit 206d4933a567147b62f463c2daa3d063ad40822b)
 2015-07-24 18:29:24 +09:00
Rohith Sharma K S
9d15860e6d YARN-3845. Scheduler page does not render RGBA color combinations in IE11. (Contributed by Mohammad Shahid Khan) 2015-07-24 12:54:07 +05:30
Akira Ajisaka
17319c4a65 HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka) 
(cherry picked from commit 02c01815eca656814febcdaca6115e5f53b9c746)
 2015-07-24 11:39:16 +09:00
Robert Kanter
ba3b40ae79 YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter) 
(cherry picked from commit 1d3026e7b3cf2f3a8a544b66ff14783cc590bdac)
 2015-07-23 14:47:28 -07:00
Andrew Wang
cf258b6d98 HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. Contributed by Zhihai Xu. 
(cherry picked from commit 6736a1ab7033523ed5f304fdfed46d7f348665b4)
 2015-07-23 14:42:44 -07:00
Allen Wittenauer
a37285620d HADOOP-11731. Rework the changelog and releasenotes (aw) 
(cherry picked from commit f383fd9b6caf4557613250c5c218b1a1b65a212b)

 Conflicts:
	hadoop-project/src/site/site.xml
 2015-07-23 14:08:10 -07:00
Haohui Mai
d3e6b40b44 HDFS-8730. Clean up the import statements in ClientProtocol. Contributed by Takanobu Asanuma. 2015-07-23 10:30:43 -07:00
Arpit Agarwal
601b503895 HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. (Contributed by Brahma Reddy Battula) 2015-07-23 10:14:01 -07:00
Wangda Tan
6baebcaedc YARN-3941. Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler. (Sunil G via wangda) 
(cherry picked from commit 3bba1800513b38a4827f7552f348db87dc47c783)
 2015-07-23 10:08:30 -07:00
Jing Zhao
71764a92c6 HDFS-8797. WebHdfsFileSystem creates too many connections for pread. Contributed by Jing Zhao. 
(cherry picked from commit e91ccfad07ec5b5674a84009772dd31a82b4e4de)
 2015-07-22 18:03:45 -07:00
Junping Du
6772c3f4dd YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He. 
(cherry picked from commit ee98d6354bbbcd0832d3e539ee097f837e5d0e31)
 2015-07-22 17:57:16 -07:00
rohithsharmaks
be2334ba3a YARN-3954. Fix TestYarnConfigurationFields#testCompareConfigurationClassAgainstXml. (varun saxena via rohithsharmaks) 2015-07-23 02:10:45 +05:30
Wangda Tan
3800e25d6e YARN-3956. Fix TestNodeManagerHardwareUtils fails on Mac (Varun Vasudev via wangda) 
(cherry picked from commit 06e5dd2c84c49460884757b56980b1b9c58af996)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-07-22 12:03:14 -07:00
Wangda Tan
3576b0ac5e YARN-3932. SchedulerApplicationAttempt#getResourceUsageReport and UserInfo should based on total-used-resources. (Bibin A Chundatt via wangda) 
(cherry picked from commit 76ec26de8099dc48ce3812c595b7ab857a600442)
 2015-07-22 11:54:38 -07:00
Colin Patrick Mccabe
d9876e69ee HADOOP-12184. Remove unused Linux-specific constants in NativeIO (Martin Walsh via Colin P. McCabe) 
(cherry picked from commit 1b3bceb58c8e536a75fa3f99cc3ceeaba91a07de)
 2015-07-22 11:35:14 -07:00
cnauroth
bb080b32d4 HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit efa97243ecb84b3b468e732897cd685e3869f480)
 2015-07-22 11:17:00 -07:00
yliu
930e344d78 HDFS-8795. Improve InvalidateBlocks#node2blocks. (yliu) 2015-07-22 15:15:08 +08:00