Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,524 Commits 326 Branches 371 Tags
Commit Graph

10524 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Konstantin V Shvachko
0b88a7f259 HDFS-9484. NNThroughputBenchmark$BlockReportStats should not send empty block reports. Contributed by Mingliang Liu. 
(cherry picked from commit 33d4588a7c57a0945f82fb14d8127d49c9ec68d2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-18 16:34:42 -08:00
Konstantin V Shvachko
69d3a71f14 HDFS-9436. Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default. Contributed by Mingliang. 
(cherry picked from commit 3aa73a867a3a5048de72e08d73ffaabe84f8ddee)
 2015-12-18 16:33:53 -08:00
Wangda Tan
15b3ff1971 YARN-4292. ResourceUtilization should be a part of NodeInfo REST API. (Sunil G via wangda) 
(cherry picked from commit a2c3bfc8c1349102a7f2bc4ea96b80b429ac227b)
(cherry picked from commit 51e448d295f6d2214c1d6455446a8e05e8a967b1)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-18 16:33:53 -08:00
Jian He
9c22910570 YARN-4398. Remove unnecessary synchronization in RMStateStore. Contributed by Ning Ding 
(cherry picked from commit 48cbde908319775b82ae30f262cca0503866e88e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-18 16:33:53 -08:00
Arpit Agarwal
cef21b7aaa HADOOP-12656. MiniKdc throws "address in use" BindException. (Contributed by Wei-Chiu Chuang) 2015-12-18 16:08:22 -08:00
Zhe Zhang
65effb76d9 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang. 
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
 2015-12-18 16:06:42 -08:00
Vinayakumar B
384628a2d6 HDFS-9393. After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy (Contributed by J.Andreina) 
(cherry picked from commit bfadf11b36e9d97e03d6ed1e71829907c2301412)
(cherry picked from commit c887bcd1f03244300a45ff70df9a9c9f2ad5a431)
 2015-12-18 11:41:27 +05:30
Akira Ajisaka
e09d026105 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 061c05cc05ff6257b14c5c4f25cbcec2d184cda7)
(cherry picked from commit af498234997d68b718abed2be7638819e93f2266)
 2015-12-18 14:00:42 +09:00
Akira Ajisaka
c18bf20154 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki. 
(cherry picked from commit bd5e207432c54cc75fd8c040e232241678987e53)
(cherry picked from commit e06c291245902a6014770134443140eb78048240)
 2015-12-18 13:13:12 +09:00
cnauroth
9a6814f37c HDFS-9571. Fix ASF Licence warnings in Jenkins reports. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 6da9deec204a4fa69dfc2d891ce934979d59b0ab)
(cherry picked from commit 7e5306e7952c1020b4cf9b4f71057ebb40db4ad7)
 2015-12-17 16:26:16 -08:00
Kihwal Lee
e5e5ba495f HDFS-9533. seen_txid in the shared edits directory is modified during bootstrapping. Contributed by Kihwal Lee. 
(cherry picked from commit 5cb1e0118b173a95c1f7bdfae1e58d7833d61c26)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/ha/BootstrapStandby.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestBootstrapStandby.java
(cherry picked from commit 3c0ae5914ca673b055a9673b4c17c8aaa570c258)
 2015-12-17 17:23:55 -06:00
Junping Du
8812be3dc1 YARN-3226. UI changes for decommissioning node. Contributed by Sunil G. 
(cherry picked from commit 1de56b0448d332717c8316c621b4f6af542a85cc)
(cherry picked from commit 6d2914a69791d66862630516142573e02b9d55d7)
 2015-12-17 15:22:37 -08:00
cnauroth
12e6f38f52 HDFS-9572. Prevent DataNode log spam if a client connects on the data transfer port but sends no data. Contributed by Chris Nauroth 
(cherry picked from commit 03bab8dea163a9ee45d09d2a0483d45cf6fe57c9)
(cherry picked from commit 294d0f6f6a90926f23cbcf8006cbc893bdb488e6)
 2015-12-17 14:05:19 -08:00
Arpit Agarwal
c8e5d2eba4 HDFS-9515. NPE when MiniDFSCluster#shutdown is invoked on uninitialized reference. (Contributed by Wei-Chiu Chuang) 2015-12-17 13:57:03 -08:00
cnauroth
1e81e1f891 Revert "HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang." 
This reverts commit a8dc35dfdf9f3ab82d88a7ef2d03e172d594499b.
 2015-12-17 13:50:02 -08:00
Allen Wittenauer
b11362fd2a HDFS-9570. Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's (Travis Campbell via aw) 
(cherry picked from commit 8d278d8d2e5a8a53308608a8fbc6ba96228e53ef)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit a5c74cd921d0305f3baa23d7dc53064cb3d09968)
 2015-12-17 11:41:11 -08:00
cnauroth
7cc11b22dd HDFS-9552. Document types of permission checks performed for HDFS operations. Contributed by Chris Nauroth. 
(cherry picked from commit 724e71f63b35695482642ed7aedacd70d08e6cb1)
(cherry picked from commit 940026fc6b2682a3b62d3e33ba977f5ae6375fbf)
 2015-12-17 10:44:00 -08:00
Arpit Agarwal
12df736673 HDFS-9565. TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky due to race condition. (Contributed by Wei-Chiu Chuang) 2015-12-17 10:38:58 -08:00
Kihwal Lee
a8dc35dfdf HDFS-9569. Log the name of the fsimage being loaded for better supportability. Contributed by Yongjun Zhang. 
(cherry picked from commit eb6939cea0343840c62b930d4adb377f5eaf879f)
 2015-12-17 10:31:37 -06:00
Junping Du
92de57bdca YARN-4452. NPE when submit Unmanaged application. Contributed by Naganarasimha G R. 
(cherry picked from commit 50bd067e1d63d4c80dc1e7bf4024bfaf42cf4416)
(cherry picked from commit 1a2ef845b54166194b133e524ad9533cc259aed2)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/metrics/SystemMetricsPublisher.java
(cherry picked from commit 0f9dd488428ae65a17043f3a976c6ef778806328)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-12-17 06:16:08 -08:00
Plamen Jeliazkov
cffa262f11 HDFS-9516. Truncate file fails with data dirs on multiple disks. Contributed by Plamen Jeliazkov. 2015-12-17 00:03:51 -08:00
Uma Mahesh
e6dc6f24a2 HDFS-9198. Coalesce IBR processing in the NN. (Daryn Sharp via umamahesh) 
(cherry picked from commit f741476146574550a1a208d58ef8be76639e5ddc)
 2015-12-16 22:50:12 -08:00
Xuan
93c483889c MAPREDUCE-6566. Add retry support to mapreduce CLI tool. Contributed by Varun Vasudev 
(cherry picked from commit d4e766de931c1cc478561a211215c517ba1f341c)
(cherry picked from commit 5891d6ed55fdc73da6afa8517ebe9f4d2b666473)
 2015-12-16 15:31:09 -08:00
Jason Lowe
d939c23cc1 YARN-4461. Redundant nodeLocalityDelay log in LeafQueue. Contributed by Eric Payne 
(cherry picked from commit 91828fef6b9314f72d1f973f00e81404dc6bba91)

Conflicts:

	hadoop-yarn-project/CHANGES.txt
 2015-12-16 23:24:51 +00:00
Vinod Kumar Vavilapalli
753c9292c2 HADOOP-12415. Fixed pom files to correctly include compile-time dependency on netty. (Tom Zeng via cos) 
Addendum commit to include CHANGES.txt entry.

(cherry picked from commit ce16541c62728f69634111dc2ddb321690d3d29b)
 2015-12-16 14:42:09 -08:00
Siddharth Seth
7415870d13 YARN-4207. Add a non-judgemental YARN app completion status. Contributed by Rich Haase. 
(cherry picked from commit 0f708d465fbc4260f2c36e8067e27cd8b285fde7)
(cherry picked from commit 433212ef878205b0c14e940dd660d1a6e8dc0238)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
 2015-12-16 11:39:37 -08:00
cnauroth
d3e1161b8d HDFS-9557. Reduce object allocation in PB conversion. Contributed by Daryn Sharp. 
(cherry picked from commit c470c8953d4927043b6383fad8e792289c634c09)
(cherry picked from commit e8e3737ce8224df41f57b5d03ed097e8ab413bda)
 2015-12-16 11:11:34 -08:00
Zhihai Xu
c4febc7d02 MAPREDUCE-6436. JobHistory cache issue. Contributed by Kai Sasaki 
(cherry picked from commit 5b7078d06921893200163a3d29c8901c3c0107cb)
 2015-12-15 22:42:19 -08:00
Uma Mahesh
58cc106378 HADOOP-12639. Improve JavaDoc for getTrimmedStrings. (BELUGA BEHR via umamahesh) 
(cherry picked from commit ae67c8424c188a2b00920108e6104690137c61b7)
 2015-12-15 15:21:58 -08:00
Andrew Wang
8e5de6cc42 HDFS-8894. Set SO_KEEPALIVE on DN server sockets. Contributed by Kanaka Kumar Avvaru. 
(cherry picked from commit 49949a4bb03aa81cbb9115e91ab1c61cc6dc8a62)
(cherry picked from commit 2796c1099f5c770d534f4bf10c1d80886d0bc194)
 2015-12-15 14:40:23 -08:00
Xuan
f22d0046de YARN-4439. Clarify NMContainerStatus#toString method. Contributed by 
Jian He

(cherry picked from commit d8a45425eba372cdebef3be50436b6ddf1c4e192)
(cherry picked from commit 992f65dd8b53ee31b6b7347e2cfe59a78d031268)
 2015-12-14 17:16:07 -08:00
Yongjun Zhang
4bc1aab49d HDFS-9514. TestDistributedFileSystem.testDFSClientPeerWriteTimeout failing; exception being swallowed. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit bf5295b118a24e762f21bb2b9054e5e0c1d1d14a)
 2015-12-14 15:40:55 -08:00
Yongjun Zhang
6c0e36b91c HDFS-9519. Some coding improvement in SecondaryNameNode#main. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 2a4c7d4facabb8b99d6dcbf4ccfe2afedf4fd445)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-12-14 15:40:13 -08:00
Xiaoyu Yao
cdf43bb438 HDFS-8785. TestDistributedFileSystem is failing in trunk. Contributed by Xiaoyu Yao. 
(cherry picked from commit 2196e39e142b0f8d1944805db2bfacd4e3244625)
 2015-12-14 15:31:37 -08:00
Jian He
bc7603e393 YARN-4402. TestNodeManagerShutdown And TestNodeManagerResync fails with bind exception. Contributed by Brahma Reddy Battula 2015-12-14 15:06:13 -08:00
Jian He
16f7ac48d4 YARN-4403. (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period. Contributed by Junping Du 2015-12-14 13:52:33 -08:00
Jing Zhao
73a055bb9f HDFS-9535. Newly completed blocks in IBR should not be considered under-replicated too quickly. Contributed by Mingliang Liu. 
(cherry picked from commit e53456981474d6e16e3c134e3777b3588dc6fedf)
(cherry picked from commit e02ad5a6187d4560c8ee58b4a5582042592fa817)
 2015-12-14 11:20:10 -08:00
Arun Suresh
c2e788a7b5 YARN-4358 addendum patch to fix javadoc error 
(cherry picked from commit 7fb212e5e672b3f285493f6c7b2598ef7e61406b)
 2015-12-12 22:26:35 -08:00
Uma Mahesh
4c0b9c9062 HDFS-9528. Cleanup namenode audit/log/exception messages. (szetszwo via umamahesh) 
(cherry picked from commit 796a676d18bd7cd3ed4113d002e0e69cf261d6d1)
 2015-12-11 19:32:40 -08:00
Yongjun Zhang
d02886bf8d HDFS-9532. Detailed exception info is lost in reportTo methods of ErrorReportAction and ReportBadBlockAction. (Yongjun Zhang) 
(cherry picked from commit f5a911452f8f6bc8a37617d1fc155e5ec23f3a78)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt

(cherry picked from commit e00888d5cba7f47e1d5006d329f2523139423da3)
 2015-12-11 18:30:57 -08:00
Kihwal Lee
937a43dc29 HDFS-9445. Datanode may deadlock while handling a bad volume. Contributed by Walter Su. 
(cherry picked from commit a48301791e9564363bc2abad4e89e344b0d7a5ff)
 2015-12-11 08:46:42 -06:00
Uma Mahesh
d028295414 HDFS-9472. concat() API does not give proper exception messages on ./reserved relative path (Rakesh R via umamahesh) 
(cherry picked from commit e363417e7b7abdd5d149f303f729ecf3e95ef8f3)
 2015-12-11 00:02:49 -08:00
Akira Ajisaka
028f66b8a2 HADOOP-12602. TestMetricsSystemImpl#testQSize occasionally fails. Contributed by Masatake Iwasaki. 
(cherry picked from commit eee0cf4611b02171e8a043f1cc5f7dbad47fc3b4)
(cherry picked from commit 5047ee56af9edd2e6240286e2238b638a738f570)
 2015-12-11 16:19:12 +09:00
Junping Du
5adf7d851c YARN-3623. Add a config to indicate the Timeline Service version. Contributed by Xuan Gong. 
(cherry picked from commit f910e4f639dc311fcb257bfcb869b1aa8b2c0643)
(cherry picked from commit 0b5e76e9ff14811ad2617e632854f21d82558e5e)
 2015-12-10 02:58:28 -08:00
Tsz-Wo Nicholas Sze
26c8950fb4 HDFS-9527. The return type of FSNamesystem.getBlockCollection should be changed to INodeFile. 2015-12-09 18:14:07 -08:00
Akira Ajisaka
59c892683f YARN-4434. NodeManager Disk Checker parameter documentation is not correct. Contributed by Weiwei Yang. 
(cherry picked from commit 16dc65811d4e0e7ab61c61295149848fe53ddd89)
(cherry picked from commit 925bb94d87db7e916ed380d4512225e796f9e03d)
 2015-12-09 16:33:12 +09:00
Uma Mahesh
9c5650cf03 HADOOP-12618. Fix NPE in TestSequenceFile. (Brahma Reddy Battula via umamahesh) 
(cherry picked from commit ad53c520630847834b3e68b7f41aa88ee10b3300)
 2015-12-08 23:03:19 -08:00
rohithsharmaks
5bc33c5ae4 YARN-4421. Remove dead code in RmAppImpl.RMAppRecoveredTransition. (Daniel Templeton via rohithsharmaks) 
(cherry picked from commit a5e2e1ecb06a3942903cb79f61f0f4bb02480f19)
 2015-12-09 11:35:02 +05:30
rohithsharmaks
6a6bbc51c4 YARN-4431. Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM. (Junpin Du via rohithsharmaks) 2015-12-09 11:06:31 +05:30
mattf
05a7fb3a9a HADOOP-12617. SPNEGO authentication request to non-default realm gets default realm name inserted in target server principal. (mattf) 2015-12-08 17:46:36 -08:00