Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,508 Commits 326 Branches 371 Tags
Commit Graph

8508 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kihwal Lee
f85530f649 HDFS-7434. DatanodeID hashCode should not be mutable. Contributed by Daryn Sharp. 
(cherry picked from commit 722b4794693d8bad1dee0ca5c2f99030a08402f9)
 2015-03-04 17:23:00 -06:00
Karthik Kambatla
f4d6c5e337 MAPREDUCE-6267. Refactor JobSubmitter#copyAndConfigureFiles into it's own class. (Chris Trezzo via kasha) 
(cherry picked from commit c66c3ac6bf9f63177279feec3f2917e4b882e2bc)
 2015-03-04 14:47:06 -08:00
Jing Zhao
b2ccf54c14 HDFS-7535. Utilize Snapshot diff report for distcp. Contributed by Jing Zhao. 
(cherry picked from commit ed70fa142cabdbc1065e4dbbc95e99c8850c4751)
 2015-03-04 10:32:39 -08:00
Jason Lowe
ab397194c3 YARN-3131. YarnClientImpl should check FAILED and KILLED state in submitApplication. Contributed by Chang Li 
(cherry picked from commit 03cc22945e5d4e953c06a313b8158389554a6aa7)
 2015-03-04 18:05:20 +00:00
Haohui Mai
d020544ef6 HDFS-7879. hdfs.dll does not export functions of the public libhdfs API. Contributed by Chris Nauroth. 2015-03-04 09:17:29 -08:00
Vinayakumar B
c24448c27b HDFS-7869. Inconsistency in the return information while performing rolling upgrade ( Contributed by J.Andreina ) 
(cherry picked from commit 3560180b6e9926aa3ee1357da59b28a4b4689a0d)
 2015-03-04 14:39:51 +05:30
Akira Ajisaka
31b3f84601 HADOOP-11666. Revert the format change of du output introduced by HADOOP-6857. Contributed by Byron Wong. 2015-03-03 21:46:28 -08:00
Aaron T. Myers
bce3d442ff HDFS-7682. {{DistributedFileSystem#getFileChecksum}} of a snapshotted file includes non-snapshotted content. Contributed by Charles Lamb. 
(cherry picked from commit f2d7a67a2c1d9dde10ed3171fdec65dff885afcc)
 2015-03-03 18:09:31 -08:00
Haohui Mai
65bfde552a HDFS-6565. Use jackson instead jetty json in hdfs-client. Contributed by Akira AJISAKA. 2015-03-03 17:58:21 -08:00
Jian He
aafe571398 YARN-3285. (Backport YARN-3168) Convert branch-2 .apt.vm files of YARN to markdown. Contributed by Masatake Iwasaki 2015-03-03 16:44:59 -08:00
Vinod Kumar Vavilapalli
6604613bc5 MAPREDUCE-6248. Exposed the internal MapReduce job's information as a public API in DistCp. Contributed by Jing Zhao. 
(cherry picked from commit 5af693fde26755b6f175bd65f93cf4a80de0d1e0)
 2015-03-03 16:29:36 -08:00
Jian He
888a445638 YARN-3222. Fixed NPE on RMNodeImpl#ReconnectNodeTransition when a node is reconnected with a different port. Contributed by Rohith Sharmaks 
(cherry picked from commit b2f1ec312ee431aef762cfb49cb29cd6f4661e86)
 2015-03-03 16:28:55 -08:00
Steve Loughran
824c32de1a HADOOP-11183. Memory-based S3AOutputstream. (Thomas Demoor via stevel) 2015-03-03 16:18:39 -08:00
Wangda Tan
0a502c665b YARN-3272. Surface container locality info in RM web UI (Jian He via wangda) 
(cherry picked from commit e17e5ba9d7e2bd45ba6884f59f8045817594b284)
 2015-03-03 11:49:45 -08:00
Arpit Agarwal
7e6624c218 HDFS-7757. Misleading error messages in FSImage.java. (Contributed by Brahma Reddy Battula) 2015-03-03 10:55:32 -08:00
Junping Du
a9613bcc94 Ability to limit running map and reduce tasks. Contributed by Jason Lowe. 
(cherry picked from commit 4228de94028f1e10ca59ce23e963e488fe566909)

Conflicts:
    hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
 2015-03-03 02:23:00 -08:00
Tsuyoshi Ozawa
b1e7f9c588 MAPREDUCE-6268. Fix typo in Task Attempt API's URL. Contributed by Ryu Kobayashi. 
(cherry picked from commit 742f9d90c00f823ad7fea7e79702fcf238fa5721)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-hs/src/site/markdown/HistoryServerRest.md
 2015-03-03 16:24:27 +09:00
Jing Zhao
6090f51725 HDFS-7871. NameNodeEditLogRoller can keep printing 'Swallowing exception' message. Contributed by Jing Zhao. 
(cherry picked from commit b442aeec95abfa1c6f835a116dfe6e186b0d841d)
 2015-03-02 20:23:10 -08:00
Gera Shegalov
5e235802de HADOOP-11605. FilterFileSystem#create with ChecksumOpt should propagate it to wrapped FS. (gera) 
(cherry picked from commit b18d3830aca00f44d31e42839578f24eecedf2c8)
 2015-03-02 18:16:58 -08:00
Steve Loughran
fe7df5b4d8 HADOOP-11449 / HADOOP-10320 ; reverting patch 6cda3a7 which triggered regression in javadocs on some java8 compilers (stevel on behalf of cnauroth) 2015-03-02 18:15:24 -08:00
Vinod Kumar Vavilapalli
253c78548b YARN-3265. Fixed a deadlock in CapacityScheduler by always passing a queue's available resource-limit from the parent queue. Contributed by Wangda Tan. 
(cherry picked from commit 14dd647c556016d351f425ee956ccf800ccb9ce2)
 2015-03-02 17:54:01 -08:00
Wangda Tan
19a8e48230 YARN-3270. Fix node label expression not getting set in ApplicationSubmissionContext (Rohit Agarwal via wangda) 
(cherry picked from commit abac6eb9d530bb1e6ff58ec3c75b17d840a0ee3f)
 2015-03-02 17:24:55 -08:00
Haohui Mai
651aa8761e HDFS-7785. Improve diagnostics information for HttpPutFailedException. Contributed by Chengbing Liu. 2015-03-02 15:35:19 -08:00
Jian He
76b7283fa1 YARN-3281. Added RMStateStore to StateMachine visualization list. Contributed by Chengbing Liu 
(cherry picked from commit 5d0bae550f5b9a6005aa1d373cfe1ec80513dbd9)
 2015-03-02 14:43:12 -08:00
Akira Ajisaka
fcd817afb0 HADOOP-11658. Externalize io.compression.codecs property. Contributed by Kai Zheng. 
(cherry picked from commit 0650e1c56f2d87ca9bdc51d7d4678895f494464a)
 2015-03-02 01:13:10 -08:00
Gera Shegalov
52d0724a20 HDFS-7789. DFSck should resolve the path to support cross-FS symlinks. (gera) 
(cherry picked from commit cbb492578ef09300821b7199de54c6508f9d7fe8)
 2015-03-02 01:05:15 -08:00
Tsz-Wo Nicholas Sze
a5f3156b30 HDFS-7439. Add BlockOpResponseProto's message to the exception messages. Contributed by Takanobu Asanuma 2015-03-02 15:05:06 +08:00
Akira Ajisaka
c40293c828 HADOOP-11615. Update ServiceLevelAuth.md for YARN. Contributed by Brahma Reddy Battula. 
(cherry picked from commit dd9cd0797c265edfa7c3f18d2efce7c8f2801a6d)
 2015-03-01 22:16:59 -08:00
Tsuyoshi Ozawa
3854b21c4c HADOOP-11634. Description of webhdfs' principal/keytab should switch places each other. Contributed by Brahma Reddy Battula. 
(cherry picked from commit e9ac88aac77dd98508854de445793c2180466ee8)
 2015-03-02 04:18:39 +09:00
Akira Ajisaka
d664705fd1 HDFS-5853. Add "hadoop.user.group.metrics.percentiles.intervals" to hdfs-default.xml (aajisaka) 
(cherry picked from commit aa55fd3096442f186aebc5a767d7e271b7224b51)
 2015-03-01 01:18:36 -08:00
Akira Ajisaka
0e10c70445 Fixed CHANGES.txt for HADOOP-10976. 2015-02-28 17:16:52 -08:00
Akira Ajisaka
f7a724ca9e HADOOP-10976. Backport "moving the source code of hadoop-tools docs to the directory under hadoop-tools" to branch-2. Contributed by Masatake Iwasaki. 
(cherry picked from commit 9112f093cde0b8242324aa5267c9beb21c38bf6b)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-02-28 17:06:58 -08:00
Wangda Tan
0b0be0056b YARN-3262. Surface application outstanding resource requests table in RM web UI. (Jian He via wangda) 
(cherry picked from commit edcecedc1c39d54db0f86a1325b4db26c38d2d4d)
 2015-02-27 16:14:35 -08:00
Tsz-Wo Nicholas Sze
c52636df3f recommit "HDFS-7769. TestHDFSCLI should not create files in hdfs project root dir." 
(cherry picked from commit acc172e3718e23ff6808ddcc01543212f1334a27)
 2015-02-27 14:20:26 -08:00
Akira Ajisaka
0f9289e848 HDFS-7685. Document dfs.namenode.heartbeat.recheck-interval in hdfs-default.xml. Contributed by Kai Sasaki. 
(cherry picked from commit 8719cdd4f68abb91bf9459bca2a5467dafb6b5ae)
 2015-02-27 12:18:46 -08:00
Tsuyoshi Ozawa
79f73f4613 YARN-2820. Retry in FileSystemRMStateStore when FS's operations fail due to IOException. Contributed by Zhihai Xu. 
(cherry picked from commit 01a1621930df17a745dd37892996c68fca3447d1)
 2015-02-28 00:57:01 +09:00
Tsz-Wo Nicholas Sze
657b027bb2 HDFS-7308. Change the packet chunk size computation in DFSOutputStream in order to enforce packet size <= 64kB. Contributed by Takuya Fukudome 2015-02-27 23:46:42 +08:00
Vinayakumar B
bc60404eaf HDFS-6753. Initialize checkDisk when DirectoryScanner not able to get files list for scanning (Contributed by J.Andreina) 
(cherry picked from commit 4f75b15628a76881efc39054612dc128e23d27be)
 2015-02-27 16:37:03 +05:30
Tsz-Wo Nicholas Sze
d223a4a594 Revert "HDFS-7769. TestHDFSCLI should not create files in hdfs project root dir." 
This reverts commit acc172e3718e23ff6808ddcc01543212f1334a27.

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-02-27 18:27:19 +08:00
Tsuyoshi Ozawa
02df51497f HADOOP-11569. Provide Merge API for MapFile to merge multiple similar MapFiles to one MapFile. Contributed by Vinayakumar B. 
(cherry picked from commit 48c7ee7553af94a57952bca03b49c04b9bbfab45)
 2015-02-27 17:46:29 +09:00
Konstantin V Shvachko
9e67f2cb0d YARN-3255. RM, NM, JobHistoryServer, and WebAppProxyServer's main() should support generic options. Contributed by Konstantin Shvachko. 2015-02-26 17:26:08 -08:00
Akira Ajisaka
8aa0c73294 MAPREDUCE-5612. Add javadoc for TaskCompletionEvent.Status. Contributed by Chris Palmer. 
(cherry picked from commit bfbf076b7dcb71b59d85b05d0a6da88195ea9902)
 2015-02-26 15:06:26 -08:00
cnauroth
5dfb793b05 HDFS-7774. Unresolved symbols error while compiling HDFS on Windows 7/32 bit. Contributed by Kiran Kumar M R. 
(cherry picked from commit c6d5b37a1c4c3acc190f5f4e27109594efb7be8c)
 2015-02-26 13:37:58 -08:00
cnauroth
264c96777e HADOOP-9922. hadoop windows native build will fail in 32 bit machine. Contributed by Kiran Kumar M R. 
(cherry picked from commit 2214dab60ff11b8de74c9d661585452a078fe0c1)
 2015-02-26 12:41:48 -08:00
Colin Patrick Mccabe
8b3b9568b6 HDFS-7819. Log WARN message for the blocks which are not in Block ID based layout (Rakesh R via Colin P. McCabe) 
(cherry picked from commit f0c980abed3843923e0eb16b626fa27334195eda)
 2015-02-26 12:03:11 -08:00
Tsuyoshi Ozawa
dc348f4894 YARN-3217. Remove httpclient dependency from hadoop-yarn-server-web-proxy. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 773b6515ac51af3484824bd6f57685a9726a1e70)
 2015-02-27 00:25:12 +09:00
Devaraj K
f83d2e4410 YARN-3256. TestClientToAMTokens#testClientTokenRace is not running against 
all Schedulers even when using ParameterizedSchedulerTestBase. Contributed
by Anubhav Dhoot.

(cherry picked from commit 0d4296f0e0f545267f2e39a868d4ffefc9844db8)
 2015-02-26 15:47:32 +05:30
Vinayakumar B
f0f3d1937d HDFS-7832. Show 'Last Modified' in Namenode's 'Browse Filesystem' (Contributed by Vinayakumar B) 
(cherry picked from commit 166eecf687765f369cd5bf210cc6d7bf493121ea)
 2015-02-26 14:37:03 +05:30
Andrew Wang
0512e50d6e HADOOP-11620. Add support for load balancing across a group of KMS for HA. Contributed by Arun Suresh. 
(cherry picked from commit 71385f9b70e22618db3f3d2b2c6dca3b1e82c317)
 2015-02-25 21:17:44 -08:00
Tsz-Wo Nicholas Sze
22b13a0ddb HDFS-7537. Add "UNDER MIN REPL'D BLOCKS" count to fsck. Contributed by GAO Rui 2015-02-26 11:47:04 +08:00