Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,013 Commits 326 Branches 371 Tags
Commit Graph

17013 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Anu Engineer
14a94e7a4f HDFS-11999. Ozone: Clarify startup error message of Datanode in case namenode is missing. Contributed by Marton Elek. 2017-06-20 16:37:03 -07:00
Lei Xu
45ff4d38e6 HDFS-11647. Add -E option in hdfs "count" command to show erasure policy summarization. Contributed by luhuichun. 2017-06-20 11:55:09 -07:00
Anu Engineer
185e3ad744 HDFS-11585. Ozone: Support force update a container. Contributed by Yuanbo Liu. 2017-06-20 11:13:12 -07:00
Wei-Chiu Chuang
2b654a493c HDFS-11978. Remove invalid '-usage' command of 'ec' and add missing commands 'addPolicies' 'listCodecs' in doc. Contributed by wenxin he. 2017-06-20 09:36:55 -07:00
Jason Lowe
dd65eea74b HADOOP-8143. Change distcp to have -pb on by default. Contributed by Mithun Radhakrishnan 2017-06-20 09:53:47 -05:00
Kihwal Lee
8c0769dee4 HDFS-11960. Successfully closed files can stay under-replicated. Contributed by Kihwal Lee. 2017-06-20 09:11:23 -05:00
Brahma Reddy Battula
2e9daa2e27 HADOOP-14533. Size of args cannot be less than zero in TraceAdmin#run as its linkedlist. Contributed by Weisen Han. 2017-06-20 20:44:31 +08:00
Akira Ajisaka
099dfe92a9
YARN-6713. Fix dead link in the Javadoc of FairSchedulerEventLog.java. Contributed by Weiwei Yang. 2017-06-20 17:20:27 +09:00
Akira Ajisaka
2c769167db
HDFS-11345. Document the configuration key for FSNamesystem lock fairness. Contributed by Erik Krogen. 2017-06-20 16:35:54 +09:00
Xiao Chen
15964ef147 HADOOP-14515. Specifically configure zookeeper-related log levels in KMS log4j. 2017-06-19 23:12:02 -07:00
Anu Engineer
f8110c3e6e HDFS-11963. Ozone: Documentation: Add getting started page. Contributed by Anu Engineer. 2017-06-19 21:29:18 -07:00
Akira Ajisaka
3369540653
HADOOP-14296. Move logging APIs over to slf4j in hadoop-tools. 2017-06-20 13:18:26 +09:00
Brahma Reddy Battula
099cbb427a HDFS-11890. Handle NPE in BlockRecoveryWorker when DN is getting shoutdown. Contributed by Surendra Singh Lilhore. 2017-06-20 11:03:56 +08:00
Masatake Iwasaki
d954a64730 HDFS-11995. HDFS Architecture documentation incorrectly describes writing to a local temporary file. Contributed by Nandakumar. 2017-06-20 08:07:42 +09:00
Xiaoyu Yao
0f671caf8d HDFS-11782. Ozone: KSM: Add listKey. Contributed by Yiqun Lin. 2017-06-19 15:55:58 -07:00
Lei Xu
73fb75017e HDFS-11916. Extend TestErasureCodingPolicies/TestErasureCodingPolicyWithSnapshot with a random EC policy. Contributed by Takanobu Asanuma. 2017-06-19 10:25:20 -07:00
Naganarasimha
ee89ac84e6 YARN-6680. Avoid locking overhead for NO_LABEL lookups. Contributed by Daryn Sharp 2017-06-19 22:42:45 +05:30
Naganarasimha
e9c2aa1bc3 YARN-6467. CSQueueMetrics needs to update the current metrics for default partition only. Contributed by Manikandan R. 2017-06-19 21:31:40 +05:30
Akira Ajisaka
300804595e
HADOOP-14540. Replace MRv1 specific terms in HostsFileReader. Contributed by hu xiaodong. 2017-06-19 19:39:36 +09:00
Akira Ajisaka
7ade5124b8
HADOOP-14538. Fix TestFilterFileSystem and TestHarFileSystem failures after DistributedFileSystem.append API. Contributed by Lei (Eddy) Xu. 2017-06-19 19:09:18 +09:00
Masatake Iwasaki
75043d3429 HADOOP-14424. Add CRC32C performance test. Contributed by LiXin Ge. 2017-06-19 09:16:45 +09:00
Naganarasimha
7582dedad1 YARN-6517. Fix warnings from Spotbugs in hadoop-yarn-common(addendum). Contributed by Weiwei Yang. 2017-06-18 19:53:42 +05:30
Lei Xu
6460df21a0 HADOOP-14395. Provide Builder pattern for DistributedFileSystem.append. Contributed by Lei (Eddy) Xu. 2017-06-16 17:24:00 -07:00
Ravi Prakash
82bbcbf37f MAPREDUCE-6897. Add Unit Test to ensure Job end notification gets sent even when appMaster stop gets YarnRuntimeException. Contributed by Gergely Novák 2017-06-16 14:25:44 -07:00
Jason Lowe
9ef2743fa1 Revert "MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko" 
This reverts commit e78542f4bea90e8545e9e06af9c07e89d2be43d9.
 2017-06-16 14:48:51 -05:00
Jason Lowe
e78542f4be MAPREDUCE-6898. TestKill.testKillTask is flaky. Contributed by Peter Bacsko 2017-06-16 14:24:54 -05:00
Xiao Chen
4ebc23ba7b HADOOP-14524. Make CryptoCodec Closeable so it can be cleaned up proactively. 2017-06-16 09:49:33 -07:00
Steve Loughran
942ecbbc98
HADOOP-14486 TestSFTPFileSystem#testGetAccessTime test failure using openJDK 1.8.0. 
Contributed by Hongyuan Li.
 2017-06-16 09:45:22 +01:00
Akira Ajisaka
e855cc4ed4
HADOOP-14289. Move log4j APIs over to slf4j in hadoop-common. 2017-06-16 13:17:10 +09:00
Andrew Wang
fb68980959 HDFS-10480. Add an admin command to list currently open files. Contributed by Manoj Govindassamy. 2017-06-15 14:46:55 -07:00
Mingliang Liu
f214a9961f HADOOP-14494. ITestJets3tNativeS3FileSystemContract tests NPEs in teardown if store undefined. Contributed by Steve Loughran 2017-06-15 11:16:16 -07:00
Lei Xu
3f5108723c HDFS-11682. TestBalancer.testBalancerWithStripedFile is flaky. (lei) 2017-06-15 11:04:50 -07:00
Lei Xu
5e7cfdca7b HADOOP-14394. Provide Builder pattern for DistributedFileSystem.create. (lei) 2017-06-15 10:59:24 -07:00
Xiao Chen
ef8edab930 HADOOP-14523. OpensslAesCtrCryptoCodec.finalize() holds excessive amounts of memory. Contributed by Misha Dmitriev. 2017-06-15 10:40:59 -07:00
Anu Engineer
3a868fe8c4 HDFS-11979. Ozone: TestContainerPersistence never uses MiniOzoneCluster. Contributed by Tsz Wo Nicholas Sze. 2017-06-15 10:33:09 -07:00
Anu Engineer
505dd9608a HDFS-11962. Ozone: Add stop-ozone.sh script. Contributed by Weiwei Yang. 2017-06-15 10:13:48 -07:00
Anu Engineer
150ac98863 HDFS-11961. Ozone: Add start-ozone.sh to quickly start ozone. Contributed by Weiwei Yang. 2017-06-15 10:02:59 -07:00
Xiaoyu Yao
a3c75be588 HDFS-11977. Ozone: cannot enable test debug/trace log. Contributed by Tsz Wo Nicholas Sze. 2017-06-15 08:25:20 -07:00
Steve Loughran
d780a67864
HADOOP-14506. Add create() contract test that verifies ancestor dir creation. 
Contributed by Sean Mackrory.
 2017-06-15 14:49:34 +01:00
Akira Ajisaka
315f07700d
HDFS-11736. OIV tests should not write outside 'target' directory. Contributed by Yiqun Lin. 2017-06-15 13:46:20 +09:00
Anu Engineer
ba1afb25cc HDFS-11969. Block Storage: Convert unnecessary info log levels to debug. Contributed by Mukul Kumar Singh. 2017-06-14 19:33:59 -07:00
Lei Xu
999c8fcbef HDFS-10999. Introduce separate stats for Replicated and Erasure Coded Blocks apart from the current Aggregated stats. (Manoj Govindassamy via lei) 2017-06-14 10:44:19 -07:00
Junping Du
6ed54f3439 MAPREDUCE-6895. Job end notification not send due to YarnRuntimeException. Contributed by yunjiong zhao. 2017-06-13 15:21:04 -07:00
Daniel Templeton
036a24bab3 MAPREDUCE-6896. Document wrong spelling in usage of MapredTestDriver tools. 
(Contributed by LiXin Ge via Daniel Templeton)
 2017-06-13 13:21:23 -07:00
Tsz-Wo Nicholas Sze
0688a1c25a HDFS-11946. Ozone: Containers in different datanodes are mapped to the same location. Contributed by Nandakumar 2017-06-13 17:25:20 +08:00
Arpit Agarwal
8633ef8e10 HADOOP-14503. Make RollingAverages a mutable metric. Contributed by Hanisha Koneru. 2017-06-12 20:43:43 -07:00
Tsz-Wo Nicholas Sze
bec79ca249 HDFS-11947. When constructing a thread name, BPOfferService may print a bogus warning message. Contributed by Weiwei Yang 2017-06-13 09:45:10 +08:00
Arpit Agarwal
b3d3ede91a HDFS-11967. TestJMXGet fails occasionally. Contributed by Arpit Agarwal. 2017-06-12 16:03:47 -07:00
Arpit Agarwal
3f0a727f75 HDFS-11907. Add metric for time taken by NameNode resource check. Contributed by Chen Liang. 2017-06-12 15:18:38 -07:00
Jonathan Eagles
a81916ea89 HADOOP-14501. Switch from aalto-xml to woodstox to handle odd XML features (jeagles) 2017-06-12 17:07:53 -05:00