Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
7,822 Commits 326 Branches 371 Tags
Commit Graph

7822 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Karthik Kambatla
3a4211ec2c MAPREDUCE-6169. MergeQueue should release reference to the current item from key and value at the end of the iteration to save memory. (Zhihai Xu via kasha) 
(cherry picked from commit 90194ca1cbd695d48c3705121c2ac9a8554578a2)
 2014-11-20 15:37:18 -08:00
Andrew Wang
85bdc3a013 HADOOP-11323. WritableComparator#compare keeps reference to byte array. Contributed by Wilfred Spiegelenburg. 
(cherry picked from commit eb4045e7652be6ceaf9dfd33e9139d67774b99ab)
 2014-11-20 11:05:50 -08:00
Haohui Mai
4b99bde929 HDFS-7413. Some unit tests should use NameNodeProtocols instead of FSNameSystem. Contributed by Haohui Mai. 2014-11-20 10:28:03 -08:00
Karthik Kambatla
7ba5bb0c5b YARN-2315. FairScheduler: Set current capacity in addition to capacity. (Zhihai Xu via kasha) 
(cherry picked from commit a9a0cc3679432774154a07d3157ffa0a43e0bf01)
 2014-11-19 20:19:54 -08:00
Karthik Kambatla
564deb75a8 YARN-2802. ClusterMetrics to include AM launch and register delays. (Zhihai Xu via kasha) 
(cherry picked from commit f9f8e750edbe6db453f0a845e2ed49ede66e0e8a)
 2014-11-19 19:50:35 -08:00
Jian He
db31ef7e7f YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Active. Contributed by Rohith Sharmaks 
(cherry picked from commit 9cb8b75ba57f18639492bfa3b7e7c11c00bb3d3b)
 2014-11-19 19:49:44 -08:00
Andrew Wang
988682ac29 HDFS-7409. Allow dead nodes to finish decommissioning if all files are fully replicated. 
(cherry picked from commit 765aecb4e127ebaf6c7b060a8b5cd40c6428e296)
 2014-11-19 17:53:25 -08:00
Jian He
c359e2a6a4 YARN-2878. Fix DockerContainerExecutor.apt.vm formatting. Contributed by Abin Shahab 
(cherry picked from commit bc4ee5e06f89b2037e0967f8ba91089ced4b7f0e)
 2014-11-19 14:45:01 -08:00
Andrew Wang
fbce4df711 HDFS-7373. Allow decommissioning of dead DataNodes. Contributed by Zhe Zhang. 
(cherry picked from commit 5bd048e8378034b496bacc73b470a25d855aceb1)
 2014-11-18 22:17:04 -08:00
Andrew Wang
2e15754a92 HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang) 
(cherry picked from commit 406c09ad1150c4971c2b7675fcb0263d40517fbf)
 2014-11-18 22:14:17 -08:00
cnauroth
00a06e28d4 HADOOP-11201. Hadoop Archives should support globs resolving to files. Contributed by Gera Shegalov. 
(cherry picked from commit 79301e80d7510f055c01a06970bb409607a4197c)
 2014-11-18 17:10:24 -08:00
cnauroth
69eb56ad6d HDFS-7398. Reset cached thread-local FSEditLogOp's on every FSEditLog#logEdit. Contributed by Gera Shegalov. 
(cherry picked from commit 9e81be01144d5cf520313608e85cdc1d8063aa15)
 2014-11-18 16:59:54 -08:00
Zhijie Shen
610e123772 YARN-2870. Updated the command to run the timeline server it the document. Contributed by Masatake Iwasaki. 
(cherry picked from commit ef38fb9758f230c3021e70b749d7a11f8bac03f5)
 2014-11-18 16:17:07 -08:00
Jian He
1412e712b4 YARN-2157. Added YARN metrics in the documentaion. Contributed by Akira AJISAKA 
(cherry picked from commit 90a968d6757511b6d89538516db0e699129d854c)
 2014-11-18 16:13:08 -08:00
Haohui Mai
6a32f77de8 HDFS-7406. SimpleHttpProxyHandler puts incorrect "Connection: Close" header. Contributed by Haohui Mai. 2014-11-18 14:53:19 -08:00
Haohui Mai
22e99e9839 HDFS-7404. Remove o.a.h.hdfs.server.datanode.web.resources. Contributed by Li Lu. 2014-11-18 11:05:25 -08:00
Andrew Wang
f157ce08f8 Revert "HDFS-7404. Remove o.a.h.hdfs.server.datanode.web.resources. Contributed by Li Lu." 
This reverts commit ad32886ae637c9a6d529a94798c75905ee6c51b3.
 2014-11-18 10:52:48 -08:00
Andrew Wang
1e14792be6 HADOOP-11312. Fix unit tests to not use uppercase key names. 
(cherry picked from commit bcd402ae380ead1234bfdfc53f485d3fb1391288)
 2014-11-18 10:48:10 -08:00
Jason Lowe
5125a8e59e HADOOP-11309. System class pattern package.Foo should match package.Foo$Bar, too. Contributed by Gera Shegalov 
(cherry picked from commit b4ca7276902ad362f746ea997f7e977a7a6abd0e)
 2014-11-18 17:23:37 +00:00
Devaraj K
09df35e51d MAPREDUCE-6049. AM JVM does not exit if MRClientService graceful shutdown 
fails. Contributed by Rohith.
(cherry picked from commit 7250b0bf914a55d0fa4802834de7f1909f1b0d6b)
 2014-11-18 22:07:26 +05:30
Haohui Mai
ad32886ae6 HDFS-7404. Remove o.a.h.hdfs.server.datanode.web.resources. Contributed by Li Lu. 2014-11-17 17:35:53 -08:00
Andrew Wang
541172f2ee HDFS-6982. nntop: top­-like tool for name node users. (Maysam Yabandeh via wang) 
(cherry picked from commit dcb8e24427b02e2f3ff9a12d2eb1eb878e3443bb)
 2014-11-17 17:34:02 -08:00
Karthik Kambatla
8df4c04c3a YARN-2690. [YARN-2574] Make ReservationSystem and its dependent classes independent of Scheduler type. (Anubhav Dhoot via kasha) 
(cherry picked from commit 2fce6d61412843f0447f60cfe02326f769edae25)
 2014-11-17 16:46:18 -08:00
Jason Lowe
0b9a1a3e03 MAPREDUCE-6162. mapred hsadmin fails on a secure cluster. Contributed by Jason Lowe 
(cherry picked from commit 09b3dee122ad20fae22ae8de74886dbf11c39343)
 2014-11-17 23:01:16 +00:00
Andrew Wang
1deefa6cf1 HADOOP-11311. Restrict uppercase key names from being created with JCEKS. 
(cherry picked from commit 48d62fad80aaa13ee1a26fca14437722ed46da25)
 2014-11-17 13:59:55 -08:00
Brandon Li
7b2a884077 HDFS-7146. NFS ID/Group lookup requires SSSD enumeration on the server. Contributed by Yongjun Zhang 
(cherry picked from commit 351c5561c2fd380ab7746ca4e91d7b838e61e03f)
 2014-11-17 13:25:43 -08:00
Jason Lowe
242fd0e39a YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been created. Contributed by Wangda Tan 
(cherry picked from commit 81c9d17af84ed87b9ded7057cb726a3855ddd32d)
 2014-11-17 21:16:54 +00:00
Aaron T. Myers
d35eba7b1f HADOOP-11157. ZKDelegationTokenSecretManager never shuts down listenerThreadPool. Contributed by Arun Suresh. 
(cherry picked from commit 07d489e6230682e0553840bb1a0e446acb9f8d19)
 2014-11-17 13:02:59 -08:00
Haohui Mai
6eb88c278c HDFS-7279. Use netty to implement DatanodeWebHdfsMethods. Contributed by Haohui Mai. 2014-11-17 12:56:03 -08:00
Vinayakumar B
5bb47d0418 HDFS-7399. Lack of synchronization in DFSOutputStream#Packet#getLastByteOffsetBlock() (Contributed by Vinayakumar B) 
(cherry picked from commit 6783d17fcf5b25165767888f756a6b7802ab1371)
 2014-11-17 20:20:36 +05:30
Colin Patrick Mccabe
5d3c130e8f HDFS-7394. Log at INFO level, not WARN level, when InvalidToken is seen in ShortCircuitCache (Keith Pak via Colin P. McCabe) 
(cherry picked from commit 26d3b7e6ae867596bbced0bfddde22d3c0d976bb)
 2014-11-16 21:21:24 -08:00
Vinod Kumar Vavilapalli
41275755c7 YARN-1703. Fixed ResourceManager web-proxy to close connections correctly. Contributed by Rohith Sharma. 
(cherry picked from commit 198fb58776ec02397af5ad83259535b0291b745c)
 2014-11-15 12:06:53 -08:00
Jian He
21054c5d14 YARN-2432. RMStateStore should process the pending events before close. Contributed by Varun Saxena 
(cherry picked from commit 9b860661a5754e829bd8c34ef092757421589bbe)
 2014-11-14 17:25:21 -08:00
cnauroth
72207f65aa HDFS-7386. Replace check "port number < 1024" with shared isPrivilegedPort method. Contributed by Yongjun Zhang. 
(cherry picked from commit 1925e2a4ae78ef4178393848b4d1d71b0f4a4709)
 2014-11-14 16:46:24 -08:00
Karthik Kambatla
8e524e8d60 HADOOP-11307. create-release script should run git clean first (kasha) 
(cherry picked from commit 4fb96dbe3bbfd3ae88b41c816e15acee04518851)
 2014-11-14 15:37:46 -08:00
Sandy Ryza
c4c77669f0 YARN-2811. In Fair Scheduler, reservation fulfillments shouldn't ignore max share (Siqi Li via Sandy Ryza) 2014-11-14 15:20:37 -08:00
Jason Lowe
ad140d1fc8 YARN-2816. NM fail to start with NPE during container recovery. Contributed by Zhihai Xu 
(cherry picked from commit 49c38898b0be64fc686d039ed2fb2dea1378df02)
 2014-11-14 21:27:16 +00:00
Colin Patrick Mccabe
5b90e428a5 Revert HADOOP-11257 because it didn't get a jenkins run yet 2014-11-14 13:06:41 -08:00
Colin Patrick Mccabe
490df57fa2 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars (iwasakims via cmccabe) 
(cherry picked from commit 10c98aed38430df5a18899b098c34f5874a798d4)
 2014-11-14 12:56:31 -08:00
Jason Lowe
00d135d75a YARN-2857. ConcurrentModificationException in ContainerLogAppender. Contributed by Mohammad Kamrul Islam 
(cherry picked from commit f2fe8a800e5b0f3875931adba9ae20c6a95aa4ff)
 2014-11-14 20:48:51 +00:00
Ravi Prakash
45692effe4 MAPREDUCE-5918. LineRecordReader can return the same decompressor to CodecPool multiple times (Sergey Murylev via raviprak) 2014-11-14 03:48:28 -08:00
Jian He
beb184ac58 YARN-2856. Fixed RMAppImpl to handle ATTEMPT_KILLED event at ACCEPTED state on app recovery. Contributed by Rohith Sharmaks 
(cherry picked from commit d005404ef7211fe96ce1801ed267a249568540fd)
 2014-11-13 15:34:56 -08:00
Haohui Mai
7aa6da654d HDFS-7395. BlockIdManager#clear() bails out when resetting the GenerationStampV1Limit. Contributed by Haohui Mai. 2014-11-13 14:43:22 -08:00
Zhijie Shen
53d6c91df9 YARN-2766. Made ApplicationHistoryManager return a sorted list of apps, attempts and containers. Contributed by Robert Kanter. 
(cherry picked from commit 3648cb57c9f018a3a339c26f5a0ca2779485521a)
 2014-11-13 13:54:30 -08:00
Vinod Kumar Vavilapalli
d35bcf2074 Revert "YARN-2603. ApplicationConstants missing HADOOP_MAPRED_HOME (Ray Chiang via aw)" 
This reverts commit b0a9cd37ab9ef45ed9a71b04f1634fa54dd4c438.

Conflicts:
	hadoop-yarn-project/CHANGES.txt

(cherry picked from commit 4ae9780e6a05bfd6b93f1c871c22761ddd8b19cb)
 2014-11-13 13:21:46 -08:00
Arun C. Murthy
fc324d7062 Preparing to release hadoop-2.6.0-rc1. 
(cherry picked from commit 9ff7315cbe9804bebcd1ec093fac7828a72ddf59)
 2014-11-13 13:03:13 -08:00
cnauroth
4e9001530f HDFS-7385. ThreadLocal used in FSEditLog class causes FSImage permission mess up. Contributed by jiangyu. 
(cherry picked from commit b0a41de68c5b08f534ca231293de053c0b0cbd5d)
 2014-11-13 12:35:39 -08:00
Tsz-Wo Nicholas Sze
679684ab10 HDFS-7358. Clients may get stuck waiting when using ByteArrayManager. 2014-11-13 12:30:59 -08:00
Arun C. Murthy
d0285d1ad6 YARN-2635. Merging to branch-2.6 for hadoop-2.6.0-rc1. 
(cherry picked from commit 81dc0ac6dcf2f34ad607da815ea0144f178691a9)
 2014-11-13 10:28:10 -08:00
Arun C. Murthy
906e0a1862 YARN-2853. Merging to branch-2.6 for hadoop-2.6.0-rc1. 
(cherry picked from commit d648e60ebab7f1942dba92e9cd2cb62b8d70419b)
 2014-11-13 10:05:07 -08:00