Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,645 Commits 326 Branches 371 Tags
Commit Graph

10645 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kihwal Lee
75bc53a86a HDFS-9279. Decomissioned capacity should not be considered for configured/used capacity. Contributed by Kihu Shukla . 
(cherry picked from commit 19a77f546657b086af8f41fa631099bdde7e010c)
 2015-10-28 11:59:36 -05:00
cnauroth
c7f87dc2d0 HADOOP-12519. hadoop-azure tests should avoid creating a metrics configuration fiale in the module root directory. Contributed by Chris Nauroth. 
(cherry picked from commit 2d10cb8e00fd84be26b51f9fba819e3e5b6cdcbf)
 2015-10-28 09:44:21 -07:00
Zhe Zhang
5a7b407929 HDFS-9255. Consolidate block recovery related implementation into a single class. Contributed by Walter Su. 
Change-Id: I31c5d4778656053e60a4263970ec5fda441e9725
 2015-10-28 07:40:47 -07:00
Steve Loughran
fe079c8b20 HADOOP-12514. Make static fields in GenericTestUtils for assertExceptionContains() package-private and final. (Mingliang Liu via stevel) 2015-10-28 10:36:26 +00:00
Tsuyoshi Ozawa
d29bff86c4 YARN-4251. TestAMRMClientOnRMRestart#testAMRMClientOnAMRMTokenRollOverOnRMRestart is failing. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 9f4dfdf4eb60cc6b13da586dabcd95bd77fc783c)
 2015-10-28 17:39:26 +09:00
yliu
7b90f74636 HDFS-9302. WebHDFS throws NullPointerException if newLength is not provided. (Jagadesh Kiran N via yliu) 2015-10-28 15:50:32 +08:00
Yongjun Zhang
6fed564d2c HDFS-9231. fsck doesn't list correct file path when Bad Replicas/Blocks are in a snapshot. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 97913f430cbe3f82ac866ae6ab8f42754102f6c0)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestFsck.java
 2015-10-28 00:06:50 -07:00
cnauroth
af0f2e27d1 HDFS-9311. Support optional offload of NameNode HA service health checks to a separate RPC server. Contributed by Chris Nauroth. 
(cherry picked from commit bf8e45298218f70e38838152f69c7705d8606bd6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
 2015-10-27 23:08:32 -07:00
cnauroth
0377795e06 HADOOP-11685. StorageException complaining " no lease ID" during HBase distributed log splitting. Contributed by Duo Xu. 
(cherry picked from commit 1f7ecb0c84042783f9fcf3f77d7d889dc58c9ead)
 2015-10-27 22:56:33 -07:00
cnauroth
a23f79b92c HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Contributed by Chris Nauroth. 
(cherry picked from commit 73822de7c38e189f7654444ff48d15cbe0df7404)
 2015-10-27 22:49:04 -07:00
Akira Ajisaka
e984534314 Add HDFS-9317 to CHANGES.txt. 
(cherry picked from commit eca51b13af1951b18ab7a5a92aaa0b9fe07d9ef8)
 2015-10-28 13:19:48 +09:00
Colin Patrick Mccabe
7eb0daefc8 HDFS-9307. fuseConnect should be private to fuse_connect.c (Mingliang Liu via Colin P. McCabe) 
(cherry picked from commit faeb6a3f89f3580a5b1a40c6a1f6205269a5aa7a)
 2015-10-27 11:41:27 -07:00
Colin Patrick Mccabe
bb87b4222c HDFS-9299. Give ReplicationMonitor a readable thread name (Staffan Friberg via Colin P. McCabe) 
(cherry picked from commit fe93577faf49ceb2ee47a7762a61625313ea773b)
 2015-10-27 11:37:54 -07:00
Zhihai Xu
73612294bd HADOOP-12178. NPE during handling of SASL setup if problem with SASL resolver class. Contributed by Steve Loughran 
(cherry picked from commit ed9806ea40b945df0637c21b68964d1d2bd204f3)
 2015-10-27 10:09:45 -07:00
Ming Ma
2c335a8434 HDFS-9259. Make SO_SNDBUF size configurable at DFSClient side for hdfs write scenario. (Mingliang Liu via mingma) 
(cherry picked from commit aa09880ab85f3c35c12373976e7b03f3140b65c8)
 2015-10-27 09:29:37 -07:00
Varun Vasudev
c5bf1cb7af YARN-4302. SLS not able start due to NPE in SchedulerApplicationAttempt. Contributed by Bibin A Chundatt. 
(cherry picked from commit c28e16b40caf1e22f72cf2214ebc2fe2eaca4d03)
 2015-10-27 20:56:45 +05:30
Tsuyoshi Ozawa
3138b43f16 YARN-3573. MiniMRYarnCluster constructor that starts the timeline server using a boolean should be marked deprecated. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 96677bef00b03057038157efeb3c2ad4702914da)
 2015-10-27 12:35:20 +09:00
Tsuyoshi Ozawa
1035637200 HADOOP-12457. [JDK8] Fix a failure of compiling common by javadoc. Contributed by Akira AJISAKA. 
(cherry picked from commit ea6b183a1a649ad2874050ade8856286728c654c)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/conf/Configuration.java
 2015-10-27 10:58:50 +09:00
Akira Ajisaka
d9156c1245 YARN-4300. [JDK8] Fix javadoc errors caused by wrong tags. (aajisaka) 
(cherry picked from commit 8a68630dd126348b859e0fbe2d14079965016772)
 2015-10-27 10:28:30 +09:00
Wangda Tan
1499af38eb YARN-3216. Max-AM-Resource-Percentage should respect node labels. (Sunil G via wangda) 
(cherry picked from commit 56e4f6237ae8b1852e82b186e08db3934f79a9db)
 2015-10-26 16:45:20 -07:00
Wangda Tan
9bf1e74171 YARN-4169. Fix racing condition of TestNodeStatusUpdaterForLabels. (Naganarasimha G R via wangda) 
(cherry picked from commit 6f606214e734d9600bc0f25a63142714f0fea633)
 2015-10-26 16:38:39 -07:00
Lei Xu
acbc8c1457 HDFS-9292. Make TestFileConcorruption independent to underlying FsDataset Implementation. (lei) 
(cherry picked from commit 399ad009158cbc6aca179396d390fe770801420f)
 2015-10-26 16:09:41 -07:00
Arpit Agarwal
764be68f47 HDFS-9305. Delayed heartbeat processing causes storm of subsequent heartbeats. (Contributed by Arpit Agarwal) 2015-10-26 15:54:08 -07:00
Andrew Wang
8e6cc44760 HDFS-8945. Update the description about replica placement in HDFS Architecture documentation. Contributed by Masatake Iwasaki. 
(cherry picked from commit e8aefdf08bc79a0ad537c1b7a1dc288aabd399b9)
 2015-10-26 15:48:15 -07:00
Lei Xu
ce02c438fd HDFS-9291. Fix TestInterDatanodeProtocol to be FsDataset-agnostic. (lei) 2015-10-26 15:17:36 -07:00
Andrew Wang
9850827c24 HDFS-9284. fsck command should not print exception trace when file not found. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 677a936bf759515ac94d9accb9bf5364f688d051)
 2015-10-26 15:15:23 -07:00
Jing Zhao
7d25646741 HADOOP-12472. Make GenericTestUtils.assertExceptionContains robust. Contributed by Steve Loughran. 
(cherry picked from commit a01a209fbed33b2ecaf9e736631e64abefae01aa)
 2015-10-26 14:03:38 -07:00
Yongjun Zhang
b50af4e04a HDFS-7284. Add more debug info to BlockInfoUnderConstruction#setGenerationStampAndVerifyReplicas. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit 5e718de522328d1112ad38063596c204aa43f539)
 2015-10-26 13:36:25 -07:00
Colin Patrick Mccabe
1405181d08 HDFS-9268. fuse_dfs chown crashes when uid is passed as -1 (cmccabe) 
(cherry picked from commit 2f1eb2bceb1df5f27649a514246b38b9ccf60cba)
 2015-10-26 13:33:45 -07:00
Wangda Tan
baa2998e93 YARN-4285. Display resource usage as percentage of queue and cluster in the RM UI (Varun Vasudev via wangda) 
(cherry picked from commit 3cc73773eb26f7469c99b25a76814d6fad0be28e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-10-26 13:12:56 -07:00
Jason Lowe
7d66e2e666 YARN-4284. condition for AM blacklisting is too narrow. Contributed by Sangjin Lee 
(cherry picked from commit 33a03af3c396097929b9cd9c790d7f52eddc13e0)
 2015-10-26 19:54:16 +00:00
Haohui Mai
aeceb2eef6 HDFS-9304. Add HdfsClientConfigKeys class to TestHdfsConfigFields#configurationClasses. Contributed by Mingliang Liu. 2015-10-26 12:03:00 -07:00
Tsuyoshi Ozawa
07169e25ce HADOOP-12513. Dockerfile lacks initial 'apt-get update'. Contributed by Akihiro Suda. 
(cherry picked from commit 123b3db743a86aa18e46ec44a08f7b2e7c7f6350)
 2015-10-26 23:19:14 +09:00
Rohith Sharma K S
33455fa415 YARN-2729. Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup. (Naganarasimha G R via rohithsharmaks) 
(cherry picked from commit 5acdde4744c131e05db7b4b5f7d684fed7608b99)
 2015-10-26 15:45:22 +05:30
Rohith Sharma K S
06ecc37e82 YARN-4223. Fixed findbugs warnings in hadoop-yarn-server-nodemanager project. (varun saxena via rohithsharmaks) 
(cherry picked from commit 092883b34a0fe62568566bbf9108882f47003f96)
 2015-10-26 15:26:08 +05:30
Tsuyoshi Ozawa
e85ebf0825 YARN-3528. Tests with 12345 as hard-coded port break jenkins. Contributed by Brahma Reddy Battula. 
Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/TestNodeManagerShutdown.java
 2015-10-26 17:06:46 +09:00
Rohith Sharma K S
e75799d5fd YARN-4246. NPE while listing app attempt. (Nijel S F via rohithsharmaks) 
(cherry picked from commit b57f08c0d2dae57b545a3baa213e18464060ae3b)
 2015-10-26 12:07:48 +05:30
Allen Wittenauer
599653ad92 YARN-3724. Use POSIX nftw(3) instead of fts(3) (Alan Burlison via aw) 2015-10-25 21:43:51 -07:00
Arun Suresh
f0580dcac0 YARN-3738. Add support for recovery of reserved apps running under dynamic queues (subru via asuresh) 
(cherry picked from commit ab8eb8770c8b8bff41dacb1a399d75906abb1ac4)
 2015-10-24 22:54:45 -07:00
Steve Loughran
fc5a433adb YARN-4296. DistributedShell Log.info is not friendly. (Xiaowei Wang via stevel) 2015-10-24 12:54:48 +01:00
Steve Loughran
65b928d8c7 YARN-4289. TestDistributedShell failing with bind exception. (Brahma Reddy Battula via stevel) 2015-10-24 12:48:03 +01:00
Arpit Agarwal
b727dfd61c HDFS-4015. Safemode should count and report orphaned blocks. (Contributed by Anu Engineer) 2015-10-23 21:40:26 -07:00
Akira Ajisaka
356e922632 YARN-4294. [JDK8] Fix javadoc errors caused by wrong reference and illegal tag. (aajisaka) 
(cherry picked from commit 7781fe1b9e89488b37217f81c246c1398407e47a)
 2015-10-24 11:56:37 +09:00
Lei Xu
509185c224 HDFS-9297. Update TestBlockMissingException to use corruptBlockOnDataNodesByDeletingBlockFile(). (Tony Wu via lei) 
(cherry picked from commit 5679e46b7f867f8f7f8195c86c37e3db7b23d7d7)
 2015-10-23 17:42:59 -07:00
Haohui Mai
558ae8c2df HDFS-9301. HDFS clients can't construct HdfsConfiguration instances. Contributed by Mingliang Liu. 2015-10-23 14:53:15 -07:00
Kihwal Lee
d24d0fd981 HDFS-9290. DFSClient#callAppend() is not backward compatible for slightly older NameNodes. Contributed by Tony Wu. 
(cherry picked from commit b9e0417bdf2b9655dc4256bdb43683eca1ab46be)
 2015-10-23 16:38:47 -05:00
Zhe Zhang
1c468c2346 HDFS-8808. dfs.image.transfer.bandwidthPerSec should not apply to -bootstrapStandby. Contributed by Zhe Zhang. 
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/BootstrapStandby.java

Change-Id: I99c314bb932b96a25f9115772267176e0b815614
 2015-10-23 14:07:05 -07:00
Jason Lowe
235e84bf3d YARN-4041. Slow delegation token renewal can severely prolong RM recovery. Contributed by Sunil G 
(cherry picked from commit d3a34a4f388155f6a7ef040e244ce7be788cd28b)
 2015-10-23 20:57:53 +00:00
Lei Xu
17be4b4c1f HDFS-9264. Minor cleanup of operations on FsVolumeList#volumes. (Walter Su via lei) 
(cherry picked from commit 533a2be5ac7c7f0473fdd24d6201582d08964e21)
 2015-10-23 13:53:52 -07:00
Jitendra Pandey
63cebf57d0 HDFS-9184. Logging HDFS operation's caller context into audit logs. Contributed by Mingliang Liu. 2015-10-23 12:17:20 -07:00