Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,873 Commits 326 Branches 371 Tags
Commit Graph

8873 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jitendra Pandey
04962efe43 HDFS-8153. Error Message points to wrong parent directory in case of path component name length error. Contributed by Anu Engineer. 
cherry picked from 369ddc67bdaf61cca3f2f766ab504e2932f6fb72
 2015-04-16 22:15:57 -07:00
Jian He
42cf8e0554 YARN-3021. YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp. Contributed by Yongjun Zhang 
(cherry picked from commit bb6dde68f19be1885a9e7f7949316a03825b6f3e)
 2015-04-16 19:44:32 -07:00
Tsz-Wo Nicholas Sze
fa7b18e387 HDFS-7891. A block placement policy with best rack failure tolerance. Contributed by Walter Su 2015-04-16 18:26:46 -07:00
Akira Ajisaka
d363f853ab Revert "Merge r1588258 from trunk, HDFS-6153. Document "fileId" and "childrenNum" fields in the FileStatus Json schema" 
This reverts commit 641cbc0febe546e350a5fd4f37e717f2b8e52d6f.
 2015-04-16 16:50:04 -05:00
Tsz-Wo Nicholas Sze
bad547d969 HDFS-8082. Move dfs.client.read.*, dfs.client.short.circuit.*, dfs.client.mmap.* and dfs.client.hedged.read.* conf from DFSConfigKeys to HdfsClientConfigKeys. 2015-04-16 13:27:15 -07:00
Haohui Mai
e1ebad8203 HDFS-8135. Remove the deprecated FSConstants class. Contributed by Li Lu. 2015-04-16 11:26:13 -07:00
Akira Ajisaka
51c458a5c4 MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li. 
(cherry picked from commit 1fa8075794894b3e0053d251788277fb88e85533)
 2015-04-16 10:06:03 -05:00
Andrew Wang
9123f26c73 HDFS-8142. DistributedFileSystem encryption zone commands should resolve relative paths. Contributed by Rakesh R. 
(cherry picked from commit 2e8ea780a45c0eccb8f106b2bf072b59446a1cc4)
 2015-04-16 07:14:53 -07:00
Jian He
6fed2c2a79 YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan 
(cherry picked from commit 1b89a3e173f8e905074ed6714a7be5c003c0e2c4)
 2015-04-15 14:03:29 -07:00
Jian He
58f99b740a YARN-3404. Display queue name on application page. Contributed by Ryu Kobayashi 
(cherry picked from commit b2e6cf607f1712d103520ca6b3ff21ecc07cd265)
 2015-04-15 13:53:24 -07:00
Akira Ajisaka
6d183561ff HDFS-8149. The footer of the Web UI "Hadoop, 2014" is old. Contributed by Brahma Reddy Battula. 
(cherry picked from commit de0f1700c150a819b38028c44ef1926507086e6c)
 2015-04-15 15:32:08 -05:00
Jing Zhao
725621d95a HDFS-7934. Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN. Contributed by J. Andreina. 
(cherry picked from commit b172d03595d1591e7f542791224607d8c5fce3e2)
 2015-04-15 13:11:15 -07:00
Jing Zhao
d4dd97eabd HDFS-8151. Always use snapshot path as source when invalid snapshot names are used for diff based distcp. Contributed by Jing Zhao. 
(cherry picked from commit 4c097e473bb1f18d1510deb61bae2bcb8c156f18)
 2015-04-15 12:39:09 -07:00
Tsuyoshi Ozawa
e977247f3e YARN-3326. Support RESTful API for getLabelsToNodes. Contributed by Naganarasimha G R. 
(cherry picked from commit e48cedc663b8a26fd62140c8e2907f9b4edd9785)
 2015-04-15 14:04:24 -05:00
Arpit Agarwal
96e12fa46a HDFS-8144. Split TestLazyPersistFiles into multiple tests. (Arpit Agarwal) 2015-04-15 10:25:16 -07:00
Wangda Tan
89a7c98436 YARN-3318. Create Initial OrderingPolicy Framework and FifoOrderingPolicy. (Craig Welch via wangda) 
(cherry picked from commit 5004e753322084e42dfda4be1d2db66677f86a1e)
 2015-04-15 09:57:52 -07:00
Andrew Wang
871bf6a765 HDFS-8117. More accurate verification in SimulatedFSDataset: replace DEFAULT_DATABYTE with patterned data. Contributed by Zhe Zhang. 2015-04-15 08:43:42 -07:00
Harsh J
01af29106a YARN-3462. Patches applied for YARN-2424 are inconsistent between trunk and branch-2. Contributed by Naganarasimha G R. 2015-04-15 09:41:43 +05:30
Jing Zhao
38b031d6ba HDFS-8127. NameNode Failover during HA upgrade can cause DataNode to finalize upgrade. Contributed by Jing Zhao. 
(cherry picked from commit fddd55279d0bdd08b3b40aba6fe2ded1d2e0d846)
 2015-04-14 15:12:37 -07:00
Tsuyoshi Ozawa
3daca4f040 YARN-3436. Fix URIs in documantion of YARN web service REST APIs. Contributed by Bibin A Chundatt. 
(cherry picked from commit 05007b45e58bd9052f503cfb8c17bcfd22a686e3)
 2015-04-14 14:14:17 -05:00
Jian He
9ebbf1bfce YARN-3361. CapacityScheduler side changes to support non-exclusive node labels. Contributed by Wangda Tan 
(cherry picked from commit 0fefda645bca935b87b6bb8ca63e6f18340d59f5)
 2015-04-14 11:46:35 -07:00
Jian He
81bbee6852 YARN-3266. RMContext#inactiveNodes should have NodeId as map key. Contributed by Chengbing Liu 
(cherry picked from commit b46ee1e7a31007985b88072d9af3d97c33a261a7)
 2015-04-14 11:31:42 -07:00
cnauroth
c7ebecfff5 HDFS-8055. NullPointerException when topology script is missing. Contributed by Anu Engineer. 
(cherry picked from commit fef596df038112cbbc86c4dc49314e274fca0190)
 2015-04-14 10:19:45 -07:00
cnauroth
9779b79ed8 HDFS-6666. Abort NameNode and DataNode startup if security is enabled but block access token is not enabled. Contributed by Vijay Bhat. 
(cherry picked from commit d45aa7647b1fecf81860ec7b563085be2af99a0b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestSecureNameNode.java
 2015-04-14 10:03:53 -07:00
Vinayakumar B
a75679cdb3 HADOOP-11819. HttpServerFunctionalTest#prepareTestWebapp should create web app directory if it does not exist. (Contributed by Rohith) 
(cherry picked from commit b5a0b24643688270e77f85aaf1af24fee2c556cc)
 2015-04-14 11:59:07 +05:30
Arpit Agarwal
d77705c980 HDFS-7701. Support reporting per storage type quota and usage with hadoop/hdfs shell. (Contributed by Peter Shi) 2015-04-13 21:20:30 -07:00
Allen Wittenauer
b7a052c84a HADOOP-7713. dfs -count -q should label output column (Jonathan Allen via aw) 2015-04-13 21:18:59 -07:00
Junping Du
7c072bf092 YARN-3443. Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM. Contributed by Sidharta Seethana. 
(cherry picked from commit 838b06ac87339494cea706d4a97e7f5383bdc442)
 2015-04-13 18:37:39 -07:00
Junping Du
a64b8915de YARN-3347. Improve YARN log command to get AMContainer logs as well as running containers logs. Contributed by Xuan Gong. 
(cherry picked from commit a77d628339afaf2f5a085c73fd81a805b18348c9)
 2015-04-13 17:41:02 -07:00
Jian He
1afea8a15a YARN-3394. Enrich WebApplication proxy documentation. Contributed by Naganarasimha G R 
(cherry picked from commit 7b4671490ae4c4ac524925e9c3c686cbf6cabd73)
 2015-04-13 17:05:58 -07:00
Jian He
d58f5c8894 YARN-3472. Fixed possible leak in DelegationTokenRenewer#allTokens. Contributed by Rohith Sharmaks 
(cherry picked from commit a1afbc48b53f6bdbd30dc8eb56a7621d49c5d6db)
 2015-04-13 14:07:51 -07:00
Karthik Kambatla
fa12700379 Fix up author name to Jun Gong in CHANGES.txt for YARN-3469 
(cherry picked from commit 5cda6fffd39fcb997b6e3cbcd0a2e2dce07153e1)
 2015-04-13 13:52:44 -07:00
Tsz-Wo Nicholas Sze
e4fe5fa2ee HDFS-8083. Move dfs.client.write.* conf from DFSConfigKeys to HdfsClientConfigKeys.Write. 2015-04-13 11:45:03 -07:00
Jian He
32b01263d3 YARN-3382. Some of UserMetricsInfo metrics are incorrectly set to root queue metrics. Contributed by Rohit Agarwal 
(cherry picked from commit 944a16579fdb54c1c420162ef830ef2ac5451c69)
 2015-04-13 10:54:15 -07:00
Tsuyoshi Ozawa
bc979ff3bf HADOOP-11811. Fix typos in hadoop-project/pom.xml. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 174d8b3a10a8262c434e1efca74b79dd4c2f65b3)
 2015-04-13 07:00:33 -05:00
Vinayakumar B
1071a57b20 HDFS-8111. NPE thrown when invalid FSImage filename given for 'hdfs oiv_legacy' cmd ( Contributed by surendra singh lilhore ) 
(cherry picked from commit 14384f5b5142a98a10ce4bffadeb13e89bda9365)
 2015-04-13 17:19:18 +05:30
cnauroth
293c763e82 HDFS-7933. fsck should also report decommissioning replicas. Contributed by Xiaoyu Yao. 
(cherry picked from commit f8f5887209a7d8e53c0a77abef275cbcaf1f7a5b)
 2015-04-11 13:24:06 -07:00
Akira Ajisaka
4801b0b478 Revert "MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li." 
This reverts commit 3de0bf9a35094f3c2ac216992d861729251b6a3d.
 2015-04-11 12:37:44 +09:00
Tsz-Wo Nicholas Sze
ef2bd4bd11 HDFS-8084. Move dfs.client.failover.* confs from DFSConfigKeys to HdfsClientConfigKeys.Failover and fix typos in the dfs.http.client.* configuration keys. 2015-04-10 19:58:42 -07:00
Haohui Mai
6f97b780df HDFS-8103. Move BlockTokenSecretManager.AccessMode into BlockTokenIdentifier. Contributed by Haohui Mai. 2015-04-10 16:36:57 -07:00
Tsz-Wo Nicholas Sze
1113aca7f8 HDFS-8100. Refactor DFSClient.Conf to a standalone class and separates short-circuit related conf to ShortCircuitConf. 2015-04-10 14:49:32 -07:00
Arun Suresh
3d17c50176 HDFS-7931. DistributedFileSystem should not look for keyProvider in cache if Encryption is disabled (asuresh) 
(cherry picked from commit 7660da95cb67cbfe034aa8fa2a5bf0f8c9fdf41a)
 2015-04-10 11:42:18 -07:00
Karthik Kambatla
ad99d268e5 YARN-3469. ZKRMStateStore: Avoid setting watches that are not required. (Jun Hong via kasha) 
(cherry picked from commit e516706b896743e47e2852be81944eb5613e3e76)
 2015-04-10 11:21:30 -07:00
Jian He
d3daf9665c YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev 2015-04-10 10:40:31 -07:00
Akira Ajisaka
3de0bf9a35 MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li. 
(cherry picked from commit 4cec9975c0e2c2fcca090888dc2c5e149c5be1e9)
 2015-04-11 01:31:44 +09:00
Junping Du
0891de0712 YARN-1376. NM need to notify the log aggregation status to RM through Node heartbeat. Contributed by Xuan Gong. 
(cherry picked from commit 92431c961741747b5d6442f4025016d48d9a6863)
 2015-04-10 08:58:07 -07:00
Akira Ajisaka
f603b9ccca MAPREDUCE-6307. Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval. Contributed by J.Andreina. 
(cherry picked from commit 83979e61a49daa67a05eed1ba64c24d31a41610a)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2015-04-10 20:23:46 +09:00
Harsh J
b817f0924d MAPREDUCE-6314. TestPipeApplication fails on trunk. Contributed by Varun Vasudev. 
(cherry picked from commit c91b2de68ad8137a909641fdec498f2024af4476)
 2015-04-10 14:03:37 +05:30
Xuan
f5b49160d9 YARN-3293. Track and display capacity scheduler health metrics in web 
UI. Contributed by Varun Vasudev

(cherry picked from commit afa5d4715a3aea2a6e93380b014c7bb8f0880383)
 2015-04-09 23:40:02 -07:00
Vinayakumar B
4aba069b37 HDFS-7939. Two fsimage_rollback_* files are created which are not deleted after rollback. (Contributed by J.Andreina) 
(cherry picked from commit 987c9e12e184b35a5abab49f4188e22509ad63a5)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-04-10 11:27:20 +05:30