Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,774 Commits 326 Branches 371 Tags
Commit Graph

3743 Commits

Author SHA1 Message Date
Akira Ajisaka
19c149cdb9 HDFS-9765. TestBlockScanner#testVolumeIteratorWithCaching fails intermittently. (aajisaka) 
(cherry picked from commit 8ed07bd3e6b6a8af3b82e9a085c74be29f8dfd87)
(cherry picked from commit 8dec72bfd73174bdc2dfa8ce845b28af48a6bca4)
 2016-02-15 19:09:51 +09:00
Akira Ajisaka
4d1c23f55c HDFS-9773. Remove dead code related to SimulatedFSDataset in tests. Contributed by Brahma Reddy Battula. 
(cherry picked from commit b0738ae673e4a95060b33498c049cd7790d6e371)
(cherry picked from commit 5e78264cde3e141ed9809b9d2d4fc2e3f99b1788)
 2016-02-15 15:35:35 +09:00
Junping Du
aed60ae0bf Set the release date for 2.6.4. 
(cherry picked from commit ec12ce8f48944c38271399a6e452aa2c2a9f5b80)
(cherry picked from commit a28be9edc72cc4fe42fab107c17bcac6789af4e5)

Conflicts:

	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2016-02-13 01:48:50 -08:00
Arpit Agarwal
8c1cf718aa HDFS-9801. ReconfigurableBase should update the cached configuration. (Arpit Agarwal) 2016-02-12 12:41:20 -08:00
Arun Suresh
4d7da8907f HDFS-9797. Log Standby exceptions thrown by RequestHedgingProxyProvider at DEBUG Level (Inigo Goiri via asuresh) 
(cherry picked from commit 9fdfb546fb67526ba261da5cbd005f33e0f1d9e1)
 2016-02-12 11:21:16 -08:00
Zhe Zhang
f72cfc416a HDFS-9644. Update encryption documentation to reflect nested EZs. (zhz) 
Change-Id: I84ae96f4711a16ded46d501c51ca322bfca5151d
 2016-02-12 10:49:41 -08:00
Masatake Iwasaki
2dd80938a2 HDFS-9700. DFSClient and DFSOutputStream should set TCP_NODELAY on sockets for DataTransferProtocol (Gary Helmling via iwasakims) 
(cherry picked from commit 372d1302c63c6f49f99be5766c5da9647ebd9ca6)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/client/impl/DfsClientConf.java

(cherry picked from commit f71fa500f9a43d928fbd27c873544898bff50dd4)
 2016-02-13 03:34:07 +09:00
Akira Ajisaka
df23f9c49d HDFS-9768. Reuse ObjectMapper instance in HDFS to improve the performance. Contributed by Lin Yiqun. 
(cherry picked from commit e6a7044b8530afded8f8e86ff309dd0e4d39238a)
(cherry picked from commit a714d04f5d8eaba34a24ee9454ceaec68ab00a15)
 2016-02-13 02:04:22 +09:00
Arpit Agarwal
58d4c045e6 HDFS-9790. HDFS Balancer should exit with a proper message if upgrade is not finalized (Contributed by Xiaobing Zhou) 2016-02-11 20:40:49 -08:00
Andrew Wang
47746f65b0 HDFS-9788. Incompatible tag renumbering in HeartbeatResponseProto. 
(cherry picked from commit aeb13ef2ab657a1c2f9d9ed5f80783f788c4953a)
(cherry picked from commit d48957075591e0c308da79eaa5412ca8f6f73c8a)
 2016-02-10 15:26:34 -08:00
Akira Ajisaka
811ab1bf94 HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit 802a7edfaed778daaa471ee96466c6d69b35934c)
(cherry picked from commit a60a0a7128d23523cde2a80bc8576ae194162fc5)
 2016-02-10 23:50:16 +09:00
Akira Ajisaka
321da0604a Revert "HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta." 
This reverts commit 3f8a30c956d464b86f91be3f0136ed7e15604f02.
 2016-02-10 23:45:44 +09:00
Uma Maheswara Rao G
de24588ca2 HDFS-9779 . TestReplicationPolicyWithNodeGroup NODE variable picks wrong rack value. Contributed by Kuhu Shukla. 
(cherry picked from commit a7fce9ab415fcc834ca1d91f913157ffd103fa5f)
 2016-02-09 15:18:07 -08:00
Allen Wittenauer
dc325ee550 HDFS-9760. WebHDFS AuthFilter cannot be configured with custom AltKerberos auth handler (Ryan Sasson via aw) 2016-02-09 14:16:02 -08:00
Akira Ajisaka
e4769775b0 HDFS-9784. Example usage is not correct in Transparent Encryption document. Contributed by Ohnishi Takashi. 
(cherry picked from commit 60d2011b7c0fe55b8bc44a141660d3e2df37a68d)
(cherry picked from commit cb53dfcc95ca9f6c45482600b52758bc096810b9)
 2016-02-10 03:30:56 +09:00
zhezhang
3257ce73bd HDFS-9244. Support nested encryption zones. 
Change-Id: I43a13035a8b27956e90967ee82058efb647c3415
 2016-02-08 16:32:11 -08:00
Uma Maheswara Rao G
3399119e72 HDFS-9777. Fix typos in DFSAdmin command line and documentation.(Wei-Chiu Chuang via umamahesh) 
(cherry picked from commit bffaa38a91b26920206a3350bf1cd60ec950aa74)
 2016-02-08 14:12:52 -08:00
Kihwal Lee
aae0f183af HDFS-9752. Permanent write failures may happen to slow writers during datanode rolling upgrades. Contributed by Walter Su. 
(cherry picked from commit 193d27de0a5d23a61cabd41162ebc3292d8526d1)
 2016-02-08 12:17:39 -06:00
Uma Maheswara Rao G
5690e11206 HDFS-9713. DataXceiver#copyBlock should return if block is pinned. Contributed by Uma Maheswara Rao G. 
(cherry picked from commit aea31eee78a287f251447686ba3f5bbcfe9c60a3)
 2016-02-07 20:59:35 -08:00
Akira Ajisaka
3f8a30c956 HDFS-9686. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta. 
(cherry picked from commit fe124da5ffc16e4795c3dd5542accd58361e1b08)
(cherry picked from commit e4c01b8b1ce511de24db00afacef1e737845a4f7)
 2016-02-06 19:33:11 +09:00
cnauroth
bad8006da1 HDFS-9761. Rebalancer sleeps too long between iterations. Contributed by Mingliang Liu. 
(cherry picked from commit c6497949e866594050153b953a85c0a1db59d2f8)
(cherry picked from commit a7232f5e1d20faf210f3718c551cbae4edb5933c)
 2016-02-05 15:08:07 -08:00
Tsz-Wo Nicholas Sze
494b6c7c4b HDFS-9726. Refactor IBR code to a new class. 2016-02-05 23:22:17 +08:00
Haohui Mai
fdb89ac0ae HDFS-9724. Degraded performance in WebHDFS listing as it does not reuse ObjectMapper. Contributed by Akira Ajisaka. 2016-02-04 13:41:14 -08:00
Kihwal Lee
6090211872 HDFS-9730. Storage ID update does not happen when there is a layout change. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 496f33de0ce80dc455cfd51f19612da6f9b914f9)
 2016-02-04 13:22:05 -06:00
Vinayakumar B
adadc220fa HDFS-9629. Update the footer of Web UI to show year 2016 (Contributed by Xiao Chen and Vinayakumar B) 
(cherry picked from commit ddcd6954d03d3caadc8b69f7b886a3a17c3c9d0c)
(cherry picked from commit 8cdfdbf815bf89eee3184ec7cd00e1924c1ea316)
 2016-02-04 13:19:53 +05:30
Konstantin V Shvachko
3f178be0bd HDFS-9503. Use generic option -fs for NNThroughputBenchmark instead of -namenode. Contributed by Mingliang Liu. 2016-02-03 14:45:09 -08:00
Masatake Iwasaki
5fd4bd1d8c HDFS-9601. NNThroughputBenchmark.BlockReportStats should handle NotReplicatedYetException on adding block (iwasakims) 2016-02-03 14:29:06 -08:00
Jing Zhao
a79f570b6c HDFS-9748. Avoid duplication in pendingReplications when addExpectedReplicasToPending is called twice. Contributed by Walter Su. 
(cherry picked from commit 7badf156049b78cabf8537fff9846a0f9924a090)
(cherry picked from commit 459c31de4a0db322f7a27a9b80dc3b2eecfa470d)
 2016-02-03 13:33:59 -08:00
Vinayakumar B
c2ec241989 HDFS-9740. Use a reasonable limit in DFSTestUtil.waitForMetric() (Contributed by Chang Li) 
(cherry picked from commit eb2fb943fd97c191fd7c4f5333087a28ee5c87d8)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java

(cherry picked from commit 6941e2ccbf6f4c7c8663a68c7a7c9ed59bb49fbf)
 2016-02-03 11:21:42 +05:30
Vinayakumar B
e045856eda HDFS-9739. DatanodeStorage.isValidStorageId() is broken (Contributed by Mingliang Liu) 
(cherry picked from commit d6b1acb940180befeb4c855d0e4a339dbc035e7d)
(cherry picked from commit e8a9a69a2756f998f08c7b8452b84fd309921443)
 2016-02-03 10:34:35 +05:30
Junping Du
847158811b Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:36:39 -08:00
Vinayakumar B
bf2936fd38 HDFS-9715. Check storage ID uniqueness on datanode startup (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 04375756a5ed6e907ee7548469c2c508aebbafb7)
(cherry picked from commit 8577c0b6a2bc7e4966866eac2bd1f2a112d0a7c1)
 2016-02-03 07:42:18 +05:30
Tsz-Wo Nicholas Sze
0ad3c51dfb HDFS-8999. Allow a file to be closed with COMMITTED but not yet COMPLETE blocks. 
(cherry picked from commit b10d8ced21a860390c46e7729a02b81d9f7b88e6)
 2016-02-03 07:41:06 +05:30
Colin Patrick Mccabe
c4c94e1cf2 HDFS-9669. TcpPeerServer should respect ipc.server.listen.queue.size (Elliot Clark via cmccabe) 
(cherry picked from commit 2da03b48eba53d4dec2a77209ad9835d808171d1)
(cherry picked from commit 60d3a3c30b05fdeec5cc369a698297ee309d620e)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataNode.java
 2016-02-02 11:05:41 -08:00
Lei Xu
dfbd0d4df4 HDFS-9721. Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference. (Xiao Chen via lei) 
(cherry picked from commit 9d494f0c0eaa05417f3a3e88487d878d1731da36)
 2016-02-02 10:43:06 -08:00
Vinayakumar B
94950c15c2 HDFS-9718. HAUtil#getConfForOtherNodes should unset independent generic keys before initialize (Contributed by DENG FEI) 
(cherry picked from commit 4d7055e0c8d1936d6c87cec14dbbfdff77b837f3)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HAUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAConfiguration.java

(cherry picked from commit 80dd039b6e78d284d09522e61d7ea1fee9425345)
 2016-02-02 12:57:42 +05:30
Yongjun Zhang
d7b01ebcbe HDFS-9406. FSImage may get corrupted after deleting snapshot. (Contributed by Jing Zhao, Stanislav Antic, Vinayakumar B, Yongjun Zhang) 
(cherry picked from commit 34ab50ea92370cc7440a8f7649286b148c2fde65)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java

(cherry picked from commit fc8d9cc758d4119064d67008432f63a590b5f67a)
 2016-02-01 14:22:35 -08:00
Lei Xu
b8360139af HDFS-9701. DN may deadlock when hot-swapping under load. (Xiao Chen via lei) 
(cherry picked from commit 12a4ebb4471f78b642e12c2ec0784c20f62cca3c)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/TestFsDatasetImpl.java
 2016-02-01 12:49:09 -08:00
Xiaoyu Yao
924e1583ed HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao. 
(cherry picked from commit b11008d54d8aa3eb9c7c10c3a0734d95b9ef41e9)
 2016-02-01 11:57:51 -08:00
Steve Loughran
dcf2c8b3c8 HDFS-9708. FSNamesystem.initAuditLoggers() doesn't trim classnames (Mingliang Liu via stevel) 2016-02-01 16:01:22 +00:00
Vinayakumar B
6eae76f7a5 HDFS-9566. Remove expensive 'BlocksMap#getStorages(Block b, final DatanodeStorage.State state)' method (Contributed by Daryn Sharp) 
(cherry picked from commit e418bd1fb0568ce7ae22f588fea2dd9c95567383)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java

(cherry picked from commit 71374cca9d0981ac21bb588b85cbc3b0b8908be0)
 2016-02-01 13:32:59 +05:30
Yongjun Zhang
f028e3d7bc HDFS-9638. Improve DistCp Help and documentation. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit eddd823cd6246ddc66218eb01009c44b0236eaaa)
 2016-01-29 12:13:18 -08:00
Yongjun Zhang
6a06a492ec HDFS-9706. Log more details in debug logs in BlockReceiver's constructor. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 8ee060311c89b7faa71dd039481a97ba15e2413d)
 2016-01-28 23:14:56 -08:00
Tsz-Wo Nicholas Sze
f09b0fe5c4 HDFS-9654. Code refactoring for HDFS-8578. 2016-01-28 11:01:47 +08:00
Tsz-Wo Nicholas Sze
0271fb1f18 HDFS-9690. ClientProtocol.addBlock is not idempotent after HDFS-8071. 2016-01-26 14:58:44 +08:00
Jitendra Pandey
f1f61eac15 HDFS-9672. o.a.h.hdfs.TestLeaseRecovery2 fails intermittently. Contributed by Mingliang Liu. 2016-01-25 17:06:23 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
3efc72ccd5 Release process for 2.7.2: Set the release date for 2.7.2 
(cherry picked from commit ec4d2d9f40c1cb52ca4561b3d010ffc046a73495)
 2016-01-25 15:47:39 -08:00
Eric Yang
6ba6f993f8 HDFS-9653. Added blocks pending deletion report to dfsadmin. 
(Weiwei Yang via eyang)
 2016-01-24 14:27:17 -08:00
Kihwal Lee
330876689b HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma. 
(cherry picked from commit b5db1d44104a8ac4c3643cc3ac841f75f31c8345)
 2016-01-22 09:20:39 -06:00
Akira Ajisaka
4b121be77e HDFS-9682. Fix a typo "aplication" in HttpFS document. Contributed by Weiwei yang. 
(cherry picked from commit 683163468219107afb57a002f2cf2a369442171d)
(cherry picked from commit 4fe28a644e77a59968a1bed6fdae175cd43ae14d)
 2016-01-22 20:12:55 +09:00