Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,909 Commits 326 Branches 371 Tags
Commit Graph

8909 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Junping Du
8de6045842 New parameter of CLI for decommissioning node gracefully in RMAdmin CLI. Contributed by Devaraj K 
(cherry picked from commit fad9d7e85b1ba0934ab592daa9d3c9550b2bb501)
 2015-04-22 10:08:16 -07:00
Akira Ajisaka
f469f9af2d YARN-3410. Addendum fix for compilation error. Contributed by Rohith. 
(cherry picked from commit b08908ae5eaf60a7fc70bf60493a533e915553c5)
 2015-04-22 17:48:55 +09:00
Haohui Mai
f02ca4ab15 HDFS-8185. Separate client related routines in HAUtil into a new class. Contributed by Haohui Mai. 2015-04-21 22:09:13 -07:00
Jian He
613a783380 YARN-3503. Expose disk utilization percentage and bad local and log dir counts in NM metrics. Contributed by Varun Vasudev 
(cherry picked from commit 674c7ef64916fabbe59c8d6cdd50ca19cf7ddb7c)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/main/java/org/apache/hadoop/yarn/server/nodemanager/NodeManager.java
 2015-04-21 21:06:06 -07:00
Jian He
dc4698bb33 YARN-3494. Expose AM resource limit and usage in CS QueueMetrics. Contributed by Rohith Sharmaks 
(cherry picked from commit bdd90110e6904b59746812d9a093924a65e72280)
 2015-04-21 20:34:30 -07:00
Wangda Tan
8a9599fb9e YARN-3410. YARN admin should be able to remove individual application records from RMStateStore. (Rohith Sharmaks via wangda) 2015-04-21 17:47:27 -07:00
Ravi Prakash
aa34aa5caa HADOOP-11827. Speed-up distcp buildListing() using threadpool (Zoran Dimitrijevic via raviprak) 2015-04-21 16:50:40 -07:00
Steve Loughran
6d8a49dd68 HADOOP-11846 TestCertificateUtil.testCorruptPEM failing on Jenkins JDK8. (Larry McCay via stevel) 2015-04-21 22:38:27 +01:00
Gera Shegalov
6f06e3b7ea MAPREDUCE-6297. Task Id of the failed task in diagnostics should link to the task page. (Siqi Li via gera) 
(cherry picked from commit 89ded89e86e5d9a634d92a5d8a7c889744d97f94)
 2015-04-21 14:21:57 -07:00
Gera Shegalov
1544c63602 HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera) 
(cherry picked from commit 6d2cf9fbbd02482315a091ab07af26e40cc5134f)
 2015-04-21 14:21:57 -07:00
Gera Shegalov
6f5dc9f5af MAPREDUCE-6293. Set job classloader on uber-job's LocalContainerLauncher event thread. (Sangjin Lee via gera) 
(cherry picked from commit 725eb52ddc647074f0bf1cc73c3029f1352f51d5)
 2015-04-21 14:21:56 -07:00
Tsuyoshi Ozawa
0b87ae27aa YARN-3495. Confusing log generated by FairScheduler. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 105afd54779852c518b978101f23526143e234a5)
 2015-04-22 05:48:16 +09:00
Allen Wittenauer
b7251723d8 HADOOP-11746. rewrite test-patch.sh (aw) 2015-04-21 21:22:09 +01:00
Colin Patrick Mccabe
447f2f699e HDFS-8133. Improve readability of deleted block check (Daryn Sharp via Colin P. McCabe) 
(cherry picked from commit 997408eaaceef20b053ee7344468e28cb9a1379b)
 2015-04-21 12:06:33 -07:00
Arun Suresh
d2a9cc287b HADOOP-11704. DelegationTokenAuthenticationFilter must pass ipaddress instead of hostname to ProxyUsers#authorize (Anubhav Dhoot via asuresh) 
(cherry picked from commit 424a00daa069bf2049014fd46ad152ec5fc77ac8)
 2015-04-21 11:35:04 -07:00
Arpit Agarwal
7b3acc5c9d HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal) 2015-04-21 10:58:12 -07:00
Vinayakumar B
e7bb0fc922 HDFS-7993. Provide each Replica details in fsck (Contributed by J.Andreina) 
(cherry picked from commit 8ddbb8dd433862509bd9b222dddafe2c3a74778a)
 2015-04-21 15:27:15 +05:30
Vinod Kumar Vavilapalli
27fc4fb998 Set the release date for 2.7.0 
(cherry picked from commit d52de61544060a04a273114f55979e7e929a576c)
 2015-04-20 20:18:01 -07:00
Vinayakumar B
961051e569 HDFS-7916. 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop (Contributed by Vinayakumar B) 
Updated CHANGES.TXT for correct version

(cherry picked from commit ed4137cebf27717e9c79eae515b0b83ab6676465)
 2015-04-21 08:00:37 +05:30
Wangda Tan
d0ea982e64 YARN-3463. Integrate OrderingPolicy Framework with CapacityScheduler. (Craig Welch via wangda) 
(cherry picked from commit 44872b76fcc0ddfbc7b0a4e54eef50fe8708e0f5)
 2015-04-20 17:13:01 -07:00
Arpit Agarwal
95a8d452c5 HDFS-8179. DFSClient#getServerDefaults returns null within 1 hour of system start. (Contributed by Xiaoyu Yao) 2015-04-20 15:42:49 -07:00
Robert Kanter
756c254293 MAPREDUCE-6238. MR2 can't run local jobs with -libjars command options which is a regression from MR1 (zxu via rkanter) 
(cherry picked from commit d50e8f09287deeb51012d08e326a2ed71a6da869)
 2015-04-20 14:14:49 -07:00
Jian He
6b454aacc3 YARN-3497. ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy. Contributed by Jason Lowe 
(cherry picked from commit f967fd2f21791c5c4a5a090cc14ee88d155d2e2b)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-04-20 10:40:09 -07:00
Vinayakumar B
c562e1b19b HDFS-8173. NPE thrown at DataNode shutdown when HTTP server was not able to create (Contributed by surendra singh lilhore) 
(cherry picked from commit c17cd4f7c163cf97d6e42865df25709f29d39e3d)
 2015-04-20 14:58:59 +05:30
Haohui Mai
5d3a4d51bd HDFS-8169. Move LocatedBlocks and related classes to hdfs-client. Contributed by Haohui Mai. 2015-04-20 00:36:19 -07:00
Arpit Agarwal
490fac391c HDFS-8152. Refactoring of lazy persist storage cases. (Arpit Agarwal) 2015-04-19 16:09:12 -07:00
Tsuyoshi Ozawa
890238b496 HDFS-8043. NPE in MiniDFSCluster teardown. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 5459b241c86cc9a26fecca9a06ceaf524e48fed4)
 2015-04-19 18:23:57 +09:00
Tsuyoshi Ozawa
e083c07913 HDFS-7863. Missing description of some methods and parameters in javadoc of FSDirDeleteOp. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 5112477d9e1f1ebc7d91757924c4bdc6eabc35a9)
 2015-04-19 18:07:19 +09:00
Jian He
6f70f1b1af YARN-3136. Fixed a synchronization problem of AbstractYarnScheduler#getTransferredContainers. Contributed by Sunil G 
(cherry picked from commit 497c86b485b1bb8a2eba52308646d8e1ee76bce3)
 2015-04-18 12:47:30 -07:00
Wangda Tan
3316cd4357 YARN-3487. CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue (Jason Lowe via wangda) 
(cherry picked from commit f47a5763acd55cb0b3f16152c7f8df06ec0e09a9)
 2015-04-17 17:23:00 -07:00
Wangda Tan
e7cbecddc3 YARN-3493. RM fails to come up with error "Failed to load/recover state" when mem settings are changed. (Jian He via wangda) 
(cherry picked from commit f65eeb412d140a3808bcf99344a9f3a965918f70)
 2015-04-17 17:15:16 -07:00
Jian He
9827da95bc YARN-3451. Display attempt start time and elapsed time on the web UI. Contributed by Rohith Sharmaks 
(cherry picked from commit 6779467ab6fcc6a02d0e8c80b138cc9df1aa831e)
 2015-04-17 15:57:36 -07:00
Jian He
57eb07d34b YARN-2696. Queue sorting in CapacityScheduler should consider node label. Contributed by Wangda Tan 
(cherry picked from commit d573f09fb93dbb711d504620af5d73840ea063a6)
 2015-04-17 13:37:34 -07:00
Junping Du
b244701fad YARN-1402. Update related Web UI and CLI with exposing client API to check log aggregation status. Contributed by Xuan Gong. 
(cherry picked from commit 1db355a875c3ecc40a244045c6812e00c8d36ef1)
 2015-04-17 13:20:27 -07:00
Haohui Mai
dbe1cec0da HADOOP-11837. AuthenticationFilter should destroy SignerSecretProvider in Tomcat deployments. Contributed by Bowen Zhang. 2015-04-17 10:59:54 -07:00
Haohui Mai
a825243280 HDFS-8165. Move GRANDFATHER_GENERATION_STAMP and GRANDFATER_INODE_ID to hdfs-client. Contributed by Haohui Mai. 2015-04-16 22:54:33 -07:00
Jitendra Pandey
04962efe43 HDFS-8153. Error Message points to wrong parent directory in case of path component name length error. Contributed by Anu Engineer. 
cherry picked from 369ddc67bdaf61cca3f2f766ab504e2932f6fb72
 2015-04-16 22:15:57 -07:00
Jian He
42cf8e0554 YARN-3021. YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp. Contributed by Yongjun Zhang 
(cherry picked from commit bb6dde68f19be1885a9e7f7949316a03825b6f3e)
 2015-04-16 19:44:32 -07:00
Tsz-Wo Nicholas Sze
fa7b18e387 HDFS-7891. A block placement policy with best rack failure tolerance. Contributed by Walter Su 2015-04-16 18:26:46 -07:00
Akira Ajisaka
d363f853ab Revert "Merge r1588258 from trunk, HDFS-6153. Document "fileId" and "childrenNum" fields in the FileStatus Json schema" 
This reverts commit 641cbc0febe546e350a5fd4f37e717f2b8e52d6f.
 2015-04-16 16:50:04 -05:00
Tsz-Wo Nicholas Sze
bad547d969 HDFS-8082. Move dfs.client.read.*, dfs.client.short.circuit.*, dfs.client.mmap.* and dfs.client.hedged.read.* conf from DFSConfigKeys to HdfsClientConfigKeys. 2015-04-16 13:27:15 -07:00
Haohui Mai
e1ebad8203 HDFS-8135. Remove the deprecated FSConstants class. Contributed by Li Lu. 2015-04-16 11:26:13 -07:00
Akira Ajisaka
51c458a5c4 MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li. 
(cherry picked from commit 1fa8075794894b3e0053d251788277fb88e85533)
 2015-04-16 10:06:03 -05:00
Andrew Wang
9123f26c73 HDFS-8142. DistributedFileSystem encryption zone commands should resolve relative paths. Contributed by Rakesh R. 
(cherry picked from commit 2e8ea780a45c0eccb8f106b2bf072b59446a1cc4)
 2015-04-16 07:14:53 -07:00
Jian He
6fed2c2a79 YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan 
(cherry picked from commit 1b89a3e173f8e905074ed6714a7be5c003c0e2c4)
 2015-04-15 14:03:29 -07:00
Jian He
58f99b740a YARN-3404. Display queue name on application page. Contributed by Ryu Kobayashi 
(cherry picked from commit b2e6cf607f1712d103520ca6b3ff21ecc07cd265)
 2015-04-15 13:53:24 -07:00
Akira Ajisaka
6d183561ff HDFS-8149. The footer of the Web UI "Hadoop, 2014" is old. Contributed by Brahma Reddy Battula. 
(cherry picked from commit de0f1700c150a819b38028c44ef1926507086e6c)
 2015-04-15 15:32:08 -05:00
Jing Zhao
725621d95a HDFS-7934. Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN. Contributed by J. Andreina. 
(cherry picked from commit b172d03595d1591e7f542791224607d8c5fce3e2)
 2015-04-15 13:11:15 -07:00
Jing Zhao
d4dd97eabd HDFS-8151. Always use snapshot path as source when invalid snapshot names are used for diff based distcp. Contributed by Jing Zhao. 
(cherry picked from commit 4c097e473bb1f18d1510deb61bae2bcb8c156f18)
 2015-04-15 12:39:09 -07:00
Tsuyoshi Ozawa
e977247f3e YARN-3326. Support RESTful API for getLabelsToNodes. Contributed by Naganarasimha G R. 
(cherry picked from commit e48cedc663b8a26fd62140c8e2907f9b4edd9785)
 2015-04-15 14:04:24 -05:00