Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,358 Commits 326 Branches 371 Tags
Commit Graph

10358 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jason Lowe
d6d642a4e3 Update CHANGES.txt to reflect commit of MR-6273 to branch-2.7 
(cherry picked from commit ecad1253b782070adc1d825af3ffd2e214823046)
 2015-10-29 18:33:24 +00:00
Andrew Wang
5e5e693a0a HDFS-9332. Fix Precondition failures from NameNodeEditLogRoller while saving namespace. 
(cherry picked from commit 888c6245e20ba6bdaa57d16b5c62b4a9eda2cdaf)
 2015-10-29 11:30:52 -07:00
Zhe Zhang
30791cb0d0 HDFS-9229. Expose size of NameNode directory as a metric. Contributed by Surendra Singh Lilhore. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/EditLogTailer.java

Change-Id: I5f5895bac4f7d7e66e95788765a514b80b9b6766
 2015-10-29 11:21:57 -07:00
Jason Lowe
145058003a MAPREDUCE-6515. Update Application priority in AM side from AM-RM heartbeat. Contributed by Sunil G 
(cherry picked from commit cf953b6258b036fc482456b4591cfb98054f48f2)
 2015-10-29 18:05:56 +00:00
Jason Lowe
c75d8b164f YARN-2902. Killing a container that is localizing can orphan resources in the DOWNLOADING state. Contributed by Varun Saxena 
(cherry picked from commit e2267de2076245bd9857f6a30e3c731df017fef8)
 2015-10-29 16:39:55 +00:00
Jian He
7d109ef5b5 YARN-4288. Fixed RMProxy to retry on IOException from local host. Contributed by Junping Du 
(cherry picked from commit c41699965e78ce5e87669d17923ab84e494c4188)
 2015-10-29 00:01:20 -07:00
Rohith Sharma K S
e3fcb711d6 YARN-4130. Duplicate declaration of ApplicationId in RMAppManager#submitApplication method. (Kai Sasaki via rohithsharmaks) 
(cherry picked from commit 656c8f952738f469766ede729dc0f25a3ce4214e)
 2015-10-29 12:25:08 +05:30
Vinayakumar B
e3f1a02f50 HDFS-9044. Give Priority to FavouredNodes , before selecting nodes from FavouredNode's Node Group (Contributed by J.Andreina) 
(cherry picked from commit 588baab160e7c328dca1c45cf3541e79218406e8)
 2015-10-29 11:44:52 +05:30
Vinayakumar B
dea66a8392 HDFS-8545. Refactor FS#getUsed() to use ContentSummary and add an API to fetch the total file length from a specific path (Contributed by J.Andreina) 
(cherry picked from commit 7d2d16f4ee87ae56dc20016a91c109dd5130f7d4)
 2015-10-29 11:30:59 +05:30
Sangjin Lee
16db203a83 Set the release date for 2.6.2 2015-10-28 20:48:49 -07:00
Haohui Mai
9e911a2439 HDFS-9168. Move client side unit test to hadoop-hdfs-client. Contributed by Haohui Mai. 2015-10-28 15:54:53 -07:00
Zhe Zhang
986dc718d3 HDFS-9295. Add a thorough test of the full KMS code path. Contributed by Daniel Templeton. 
Change-Id: Ife1abb2f8e9a30102c4f705c47646d9ac8328786
 2015-10-28 14:36:56 -07:00
Xuan
9ce5069d16 YARN-2859. ApplicationHistoryServer binds to default port 8188 in 
MiniYARNCluster. Contributed by Vinod Kumar Vavilapalli

(cherry picked from commit 27414dac66f278b61fc23762204b01a1c508178a)
 2015-10-28 10:33:56 -07:00
Kihwal Lee
75bc53a86a HDFS-9279. Decomissioned capacity should not be considered for configured/used capacity. Contributed by Kihu Shukla . 
(cherry picked from commit 19a77f546657b086af8f41fa631099bdde7e010c)
 2015-10-28 11:59:36 -05:00
cnauroth
c7f87dc2d0 HADOOP-12519. hadoop-azure tests should avoid creating a metrics configuration fiale in the module root directory. Contributed by Chris Nauroth. 
(cherry picked from commit 2d10cb8e00fd84be26b51f9fba819e3e5b6cdcbf)
 2015-10-28 09:44:21 -07:00
Zhe Zhang
5a7b407929 HDFS-9255. Consolidate block recovery related implementation into a single class. Contributed by Walter Su. 
Change-Id: I31c5d4778656053e60a4263970ec5fda441e9725
 2015-10-28 07:40:47 -07:00
Steve Loughran
fe079c8b20 HADOOP-12514. Make static fields in GenericTestUtils for assertExceptionContains() package-private and final. (Mingliang Liu via stevel) 2015-10-28 10:36:26 +00:00
Tsuyoshi Ozawa
d29bff86c4 YARN-4251. TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 9f4dfdf4eb60cc6b13da586dabcd95bd77fc783c)
 2015-10-28 17:39:26 +09:00
yliu
7b90f74636 HDFS-9302. WebHDFS throws NullPointerException if newLength is not provided. (Jagadesh Kiran N via yliu) 2015-10-28 15:50:32 +08:00
Yongjun Zhang
6fed564d2c HDFS-9231. fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 97913f430cbe3f82ac866ae6ab8f42754102f6c0)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
 2015-10-28 00:06:50 -07:00
cnauroth
af0f2e27d1 HDFS-9311. Support optional offload of NameNode HA service health checks to a separate RPC server. Contributed by Chris Nauroth. 
(cherry picked from commit bf8e45298218f70e38838152f69c7705d8606bd6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
 2015-10-27 23:08:32 -07:00
cnauroth
0377795e06 HADOOP-11685. StorageException complaining " no lease ID" during HBase distributed log splitting. Contributed by Duo Xu. 
(cherry picked from commit 1f7ecb0c84042783f9fcf3f77d7d889dc58c9ead)
 2015-10-27 22:56:33 -07:00
cnauroth
a23f79b92c HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Contributed by Chris Nauroth. 
(cherry picked from commit 73822de7c38e189f7654444ff48d15cbe0df7404)
 2015-10-27 22:49:04 -07:00
Akira Ajisaka
e984534314 Add HDFS-9317 to CHANGES.txt. 
(cherry picked from commit eca51b13af1951b18ab7a5a92aaa0b9fe07d9ef8)
 2015-10-28 13:19:48 +09:00
Colin Patrick Mccabe
7eb0daefc8 HDFS-9307. fuseConnect should be private to fuse_connect.c (Mingliang Liu via Colin P. McCabe) 
(cherry picked from commit faeb6a3f89f3580a5b1a40c6a1f6205269a5aa7a)
 2015-10-27 11:41:27 -07:00
Colin Patrick Mccabe
bb87b4222c HDFS-9299. Give ReplicationMonitor a readable thread name (Staffan Friberg via Colin P. McCabe) 
(cherry picked from commit fe93577faf49ceb2ee47a7762a61625313ea773b)
 2015-10-27 11:37:54 -07:00
Zhihai Xu
73612294bd HADOOP-12178. NPE during handling of SASL setup if problem with SASL resolver class. Contributed by Steve Loughran 
(cherry picked from commit ed9806ea40b945df0637c21b68964d1d2bd204f3)
 2015-10-27 10:09:45 -07:00
Ming Ma
2c335a8434 HDFS-9259. Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario. (Mingliang Liu via mingma) 
(cherry picked from commit aa09880ab85f3c35c12373976e7b03f3140b65c8)
 2015-10-27 09:29:37 -07:00
Varun Vasudev
c5bf1cb7af YARN-4302. SLS not able start due to NPE in SchedulerApplicationAttempt. Contributed by Bibin A Chundatt. 
(cherry picked from commit c28e16b40caf1e22f72cf2214ebc2fe2eaca4d03)
 2015-10-27 20:56:45 +05:30
Tsuyoshi Ozawa
3138b43f16 YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 96677bef00b03057038157efeb3c2ad4702914da)
 2015-10-27 12:35:20 +09:00
Tsuyoshi Ozawa
1035637200 HADOOP-12457. [JDK8] Fix a failure of compiling common by javadoc. Contributed by Akira AJISAKA. 
(cherry picked from commit ea6b183a1a649ad2874050ade8856286728c654c)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
 2015-10-27 10:58:50 +09:00
Akira Ajisaka
d9156c1245 YARN-4300. [JDK8] Fix javadoc errors caused by wrong tags. (aajisaka) 
(cherry picked from commit 8a68630dd126348b859e0fbe2d14079965016772)
 2015-10-27 10:28:30 +09:00
Wangda Tan
1499af38eb YARN-3216. Max-AM-Resource-Percentage should respect node labels. (Sunil G via wangda) 
(cherry picked from commit 56e4f6237ae8b1852e82b186e08db3934f79a9db)
 2015-10-26 16:45:20 -07:00
Wangda Tan
9bf1e74171 YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda) 
(cherry picked from commit 6f606214e734d9600bc0f25a63142714f0fea633)
 2015-10-26 16:38:39 -07:00
Lei Xu
acbc8c1457 HDFS-9292. Make TestFileConcorruption independent to underlying FsDataset Implementation. (lei) 
(cherry picked from commit 399ad009158cbc6aca179396d390fe770801420f)
 2015-10-26 16:09:41 -07:00
Arpit Agarwal
764be68f47 HDFS-9305. Delayed heartbeat processing causes storm of subsequent heartbeats. (Contributed by Arpit Agarwal) 2015-10-26 15:54:08 -07:00
Andrew Wang
8e6cc44760 HDFS-8945. Update the description about replica placement in HDFS Architecture documentation. Contributed by Masatake Iwasaki. 
(cherry picked from commit e8aefdf08bc79a0ad537c1b7a1dc288aabd399b9)
 2015-10-26 15:48:15 -07:00
Lei Xu
ce02c438fd HDFS-9291. Fix TestInterDatanodeProtocol to be FsDataset-agnostic. (lei) 2015-10-26 15:17:36 -07:00
Andrew Wang
9850827c24 HDFS-9284. fsck command should not print exception trace when file not found. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 677a936bf759515ac94d9accb9bf5364f688d051)
 2015-10-26 15:15:23 -07:00
Jing Zhao
7d25646741 HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust. Contributed by Steve Loughran. 
(cherry picked from commit a01a209fbed33b2ecaf9e736631e64abefae01aa)
 2015-10-26 14:03:38 -07:00
Yongjun Zhang
b50af4e04a HDFS-7284. Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 5e718de522328d1112ad38063596c204aa43f539)
 2015-10-26 13:36:25 -07:00
Colin Patrick Mccabe
1405181d08 HDFS-9268. fuse_dfs chown crashes when uid is passed as -1 (cmccabe) 
(cherry picked from commit 2f1eb2bceb1df5f27649a514246b38b9ccf60cba)
 2015-10-26 13:33:45 -07:00
Wangda Tan
baa2998e93 YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda) 
(cherry picked from commit 3cc73773eb26f7469c99b25a76814d6fad0be28e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-10-26 13:12:56 -07:00
Jason Lowe
7d66e2e666 YARN-4284. condition for AM blacklisting is too narrow. Contributed by Sangjin Lee 
(cherry picked from commit 33a03af3c396097929b9cd9c790d7f52eddc13e0)
 2015-10-26 19:54:16 +00:00
Haohui Mai
aeceb2eef6 HDFS-9304. Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses. Contributed by Mingliang Liu. 2015-10-26 12:03:00 -07:00
Tsuyoshi Ozawa
07169e25ce HADOOP-12513. Dockerfile lacks initial 'apt-get update'. Contributed by Akihiro Suda. 
(cherry picked from commit 123b3db743a86aa18e46ec44a08f7b2e7c7f6350)
 2015-10-26 23:19:14 +09:00
Rohith Sharma K S
33455fa415 YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks) 
(cherry picked from commit 5acdde4744c131e05db7b4b5f7d684fed7608b99)
 2015-10-26 15:45:22 +05:30
Rohith Sharma K S
06ecc37e82 YARN-4223. Fixed findbugs warnings in hadoop-yarn-server-nodemanager project. (varun saxena via rohithsharmaks) 
(cherry picked from commit 092883b34a0fe62568566bbf9108882f47003f96)
 2015-10-26 15:26:08 +05:30
Tsuyoshi Ozawa
e85ebf0825 YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula. 
Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeManagerShutdown.java
 2015-10-26 17:06:46 +09:00
Rohith Sharma K S
e75799d5fd YARN-4246. NPE while listing app attempt. (Nijel S F via rohithsharmaks) 
(cherry picked from commit b57f08c0d2dae57b545a3baa213e18464060ae3b)
 2015-10-26 12:07:48 +05:30