Colin Patrick Mccabe
|
8315582c4f
|
HDFS-9517. Fix missing @Test annotation on TestDistCpUtils.testUnpackAttributes (Wei-Chiu Chuang via cmccabe)
|
2016-01-13 16:28:06 -08:00 |
Lei Xu
|
126705f67e
|
HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei)
|
2016-01-12 12:19:53 -08:00 |
Xiaoyu Yao
|
c2e2e13455
|
HDFS-8584. NPE in distcp when ssl configuration file does not exist in class path. Contributed by Surendra Singh Lilhore.
|
2016-01-11 17:08:26 -08:00 |
Zhe Zhang
|
95f32015ad
|
HDFS-9630. DistCp minor refactoring and clean up. Contributed by Kai Zheng.
Change-Id: I363c4ffcac32116ddcdc0a22fac3db92f14a0db0
|
2016-01-11 09:46:56 -08:00 |
cnauroth
|
0e76f1fcea
|
HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
|
2016-01-09 22:18:11 -08:00 |
|
cnauroth
|
f0fa6d869b
|
HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
|
2016-01-08 20:18:59 -08:00 |
|
cnauroth
|
978bbdfeb2
|
HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
|
2016-01-06 11:15:59 -08:00 |
Ravi Prakash
|
2d16f40dab
|
HADOOP-12689. S3 filesystem operations stopped working correctly
|
2016-01-05 23:26:03 -08:00 |
Wangda Tan
|
a9594c61bb
|
YARN-4510. Fix SLS startup failure caused by NPE. (Bibin A Chundatt via wangda)
(cherry picked from commit 6eefae1b33)
|
2015-12-30 15:39:27 -08:00 |
|
Wangda Tan
|
8310b2e9ff
|
YARN-4522. Queue acl can be checked at app submission. (Jian He via wangda)
|
2015-12-30 15:30:12 -08:00 |
|
Wangda Tan
|
79c41b1d83
|
YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil G via wangda)
|
2015-12-16 13:18:19 -08:00 |
Robert Kanter
|
6d84cc16b3
|
MAPREDUCE-6550. archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor (rkanter)
|
2015-11-25 17:12:40 -08:00 |
Akira Ajisaka
|
bab03f3ee6
|
HADOOP-12598. Add XML namespace declarations for some hadoop/tools modules. Contributed by Xin Wang.
|
2015-11-26 01:21:20 +09:00 |
Karthik Kambatla
|
52948bb20b
|
YARN-3980. Plumb resource-utilization info in node heartbeat through to the scheduler. (Inigo Goiri via kasha)
|
2015-11-24 13:47:17 +05:30 |
Haohui Mai
|
dc46c46b91
|
HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux.
|
2015-11-22 18:10:08 -08:00 |
|
Haohui Mai
|
0d27917042
|
HADOOP-12098. Remove redundant test dependencies in Hadoop Archives. Contributed by Varun Saxena.
|
2015-11-22 17:25:22 -08:00 |
|
Haohui Mai
|
176ff5ce90
|
HDFS-9402. Switch DataNode.LOG to use slf4j. Contributed by Walter Su.
|
2015-11-22 15:54:41 -08:00 |
|
Akira Ajisaka
|
f94d892704
|
HADOOP-12545. Hadoop javadoc has broken links for AccessControlList, ImpersonationProvider, DefaultImpersonationProvider, and DistCp. Contributed by Arshad Mohammad.
|
2015-11-13 21:52:57 +09:00 |
|
Akira Ajisaka
|
3ae82863f0
|
HADOOP-12553. [JDK8] Fix javadoc error caused by illegal tag. (aajisaka)
|
2015-11-08 19:17:57 +09:00 |
|
Lei Xu
|
bff7c90a56
|
HADOOP-11684. S3a to use thread pool that blocks clients. (Thomas Demoor and Aaron Fabbri via lei)
|
2015-11-05 18:35:15 -08:00 |
Allen Wittenauer
|
19a0c2660c
|
MAPREDUCE-1125. SerialUtils.cc: deserializeFloat is out of sync with SerialUtils.hh (Simone Leo via aw)
|
2015-11-05 16:57:22 -08:00 |
|
Allen Wittenauer
|
fc7cd46faf
|
MAPREDUCE-3914. Mismatched free() / delete / delete [] in HadoopPipes (Joe Mudd via aw)
|
2015-11-05 16:53:32 -08:00 |
|
cnauroth
|
0fb1867fd6
|
HADOOP-12540. TestAzureFileSystemInstrumentation#testClientErrorMetrics fails intermittently due to assumption that a lease error will be thrown. Contributed by Gaurav Kanade.
|
2015-11-04 10:28:44 -08:00 |
Varun Vasudev
|
73b9c7b82b
|
HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. Contributed by Allen Wittenauer.
|
2015-11-04 15:56:17 +05:30 |
|
cnauroth
|
9e7dcab185
|
HADOOP-12508. delete fails with exception when lease is held on blob. Contributed by Gaurav Kanade.
|
2015-11-02 10:21:39 -08:00 |
|
cnauroth
|
3ce0a6502e
|
HADOOP-12533. Introduce FileNotFoundException in WASB for read and seek API. Contributed by Dushyanth.
|
2015-11-02 10:17:41 -08:00 |
Kihwal Lee
|
b24fe06483
|
Addendum to MAPREDUCE-6451
|
2015-10-30 16:05:23 -05:00 |
|
Kihwal Lee
|
2868ca0328
|
MAPREDUCE-6451. DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic. Contributed by Kuhu Shukla.
|
2015-10-30 14:56:41 -05:00 |
Gábor Lipták
|
18727c63da
|
HADOOP-12133 Add schemas to Maven Assembly XMLs
Signed-off-by: Allen Wittenauer <aw@apache.org>
|
2015-10-30 11:36:52 -07:00 |
|
cnauroth
|
2d10cb8e00
|
HADOOP-12519. hadoop-azure tests should avoid creating a metrics configuration fiale in the module root directory. Contributed by Chris Nauroth.
|
2015-10-28 09:44:10 -07:00 |
|
cnauroth
|
1f7ecb0c84
|
HADOOP-11685. StorageException complaining " no lease ID" during HBase distributed log splitting. Contributed by Duo Xu.
|
2015-10-27 22:56:22 -07:00 |
|
cnauroth
|
73822de7c3
|
HADOOP-12520. Use XInclude in hadoop-azure test configuration to isolate Azure Storage account keys for service integration tests. Contributed by Chris Nauroth.
|
2015-10-27 22:48:56 -07:00 |
|
Varun Vasudev
|
c28e16b40c
|
YARN-4302. SLS not able start due to NPE in SchedulerApplicationAttempt. Contributed by Bibin A Chundatt.
|
2015-10-27 20:56:00 +05:30 |
|
Akira Ajisaka
|
bcb2386e39
|
HADOOP-12515. Mockito dependency is missing in hadoop-kafka module. Contributed by Kai Zheng.
|
2015-10-27 20:17:16 +09:00 |
|
cnauroth
|
cb282d5b89
|
HADOOP-12484. Single File Rename Throws Incorrectly In Potential Race Condition Scenarios. Contributed by Gaurav Kanade.
|
2015-10-22 14:29:57 -07:00 |
|
cnauroth
|
47641fcbc9
|
HADOOP-12334. Change Mode Of Copy Operation of HBase WAL Archiving to bypass Azure Storage Throttling after retries. Contributed by Gaurav Kanade.
|
2015-10-22 12:21:32 -07:00 |
Robert Kanter
|
0c4af0f998
|
MAPREDUCE-6495. Docs for archive-logs tool (rkanter)
|
2015-10-20 17:34:34 -07:00 |
|
Haohui Mai
|
da8441d0fe
|
HDFS-9167. Update pom.xml in other modules to depend on hdfs-client instead of hdfs. Contributed by Mingliang Liu.
|
2015-10-13 15:24:24 -07:00 |
|
Haohui Mai
|
7e2c971fed
|
Revert "HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu."
This reverts commit fa5a54cac7.
|
2015-10-10 03:24:59 -07:00 |
|
Haohui Mai
|
fa5a54cac7
|
HADOOP-12469. distcp shout not ignore the ignoreFailures option. Contributed by Mingliang Liu.
|
2015-10-09 22:38:06 -07:00 |
|
Robert Kanter
|
1bca1bb517
|
MAPREDUCE-6503. archive-logs tool should use HADOOP_PREFIX instead of HADOOP_HOME (rkanter)
|
2015-10-06 16:49:50 -07:00 |
|
cnauroth
|
5f6edb30c2
|
HADOOP-12350. WASB Logging: Improve WASB Logging around deletes, reads and writes. Contributed by Dushyanth.
|
2015-10-05 20:11:41 -07:00 |
|
Allen Wittenauer
|
b59e434116
|
HADOOP-10949. metrics2 sink plugin for Apache Kafka (Babak Behzad via aw)
|
2015-10-05 14:02:07 -07:00 |
|
Akira Ajisaka
|
ecbfd68974
|
HADOOP-10296. Incorrect null check in SwiftRestClient#buildException(). Contributed by Rahul Palamuttam and Kanaka Kumar Avvaru.
|
2015-10-01 18:25:31 +02:00 |
|
Robert Kanter
|
5db371f52f
|
MAPREDUCE-6494. Permission issue when running archive-logs tool as different users (rkanter)
|
2015-09-30 17:33:53 -07:00 |
|
Kihwal Lee
|
3abbdc929b
|
HADOOP-12446. Undeprecate createNonRecursive(). Contributed by Ted Yu.
|
2015-09-28 17:31:51 -05:00 |
Harsh J
|
66dad854c0
|
MAPREDUCE-6471. Document distcp incremental copy. Contributed by Neelesh Srinivas Salian.
|
2015-09-28 13:12:43 +05:30 |
|
cnauroth
|
7fe521b1dd
|
HADOOP-11918. Listing an empty s3a root directory throws FileNotFound. Contributed by Lei (Eddy) Xu.
|
2015-09-25 22:33:53 -07:00 |
|
Robert Kanter
|
d3c49e7662
|
MAPREDUCE-6480. archive-logs tool may miss applications (rkanter)
|
2015-09-25 15:02:42 -07:00 |
Jian He
|
89cab1ba5f
|
YARN-1651. CapacityScheduler side changes to support container resize. Contributed by Wangda Tan
|
2015-09-23 13:29:38 -07:00 |
|
Harsh J
|
cc2b473990
|
MAPREDUCE-5045. UtilTest#isCygwin method appears to be unused. Contributed by Neelesh Srinivas Salian.
|
2015-09-22 21:38:06 +05:30 |
Tsuyoshi Ozawa
|
dfd807afab
|
HADOOP-12428. Fix inconsistency between log-level guards and statements. Contributed by Jagadesh Kiran N and Jackie Chang.
|
2015-09-22 12:54:29 +09:00 |
Steve Loughran
|
7269906254
|
HADOOP-12087. [JDK8] Fix javadoc errors caused by incorrect or illegal tags. (Akira AJISAKA via stevel).
|
2015-09-13 14:25:26 +01:00 |
|
Karthik Kambatla
|
119cc75e7e
|
MAPREDUCE-6415. Create a tool to combine aggregated logs into HAR files. (Robert Kanter via kasha)
|
2015-09-09 17:45:19 -07:00 |
|
Tsuyoshi Ozawa
|
355eaaa33d
|
HADOOP-10318. Incorrect reference to nodeFile in RumenToSLSConverter error message. Contributed by Wei Yan.
|
2015-09-03 22:48:53 +09:00 |
Lei Xu
|
6ab2d19f5c
|
HADOOP-12346. Increase some default timeouts / retries for S3a connector. (Sean Mackrory via Lei (Eddy) Xu)
|
2015-08-29 09:59:30 -07:00 |
Rohith Sharma K S
|
feaf034994
|
YARN-3896. RMNode transitioned from RUNNING to REBOOTED because its response id has not been reset synchronously. (Jun Gong via rohithsharmaks)
|
2015-08-24 11:25:07 +05:30 |
Yongjun Zhang
|
0bc15cb6e6
|
HDFS-8828. Utilize Snapshot diff report to build diff copy list in distcp. (Yufei Gu via Yongjun Zhang)
|
2015-08-20 08:02:54 -07:00 |
|
cnauroth
|
3da0bedaec
|
HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth.
|
2015-08-05 14:56:41 -07:00 |
|
Lei Xu
|
d5403747b5
|
HADOOP-12269. Update aws-sdk dependency to 1.10.6 (Thomas Demoor via Lei (Eddy) Xu)
|
2015-08-04 18:51:52 -07:00 |
|
cnauroth
|
efa97243ec
|
HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu.
|
2015-07-22 11:16:49 -07:00 |
Vinayakumar B
|
94c6a4aa85
|
HADOOP-12017. Hadoop archives command should use configurable replication factor when closing (Contributed by Bibin A Chundatt)
|
2015-07-22 10:25:49 +05:30 |
|
Allen Wittenauer
|
68d1f4bfe8
|
HADOOP-11762. Enable swift distcp to secure HDFS (Chen He via aw)
|
2015-07-21 11:19:29 -07:00 |
|
Wangda Tan
|
c39ca541f4
|
YARN-2003. Support for Application priority : Changes in RM and Capacity Scheduler. (Sunil G via wangda)
|
2015-07-21 09:57:23 -07:00 |
|
Vinayakumar B
|
87f29c6b8a
|
HADOOP-12214. Parse 'HadoopArchive' commandline using cli Options. (Contributed by Vinayakumar B)
|
2015-07-21 13:12:46 +05:30 |
|
Steve Loughran
|
05130e94c5
|
HADOOP-12235 hadoop-openstack junit & mockito dependencies should be "provided". (Ted Yu via stevel)
|
2015-07-20 11:22:39 +01:00 |
Chris Douglas
|
a431ed9075
|
HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl
|
2015-07-13 15:36:11 -07:00 |
Ming Ma
|
08244264c0
|
YARN-3445. Cache runningApps in RMNode for getting running apps on given NodeId. (Junping Du via mingma)
|
2015-07-10 08:30:10 -07:00 |
|
Chris Douglas
|
1a0752d85a
|
HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl
|
2015-07-09 17:48:43 -07:00 |
|
Robert Kanter
|
aaafa0b2ee
|
HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter)
|
2015-06-30 16:49:27 -07:00 |
|
cnauroth
|
460e98f7b3
|
HADOOP-12089. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu.
|
2015-06-29 13:48:02 -07:00 |
|
Colin Patrick Mccabe
|
5a27c3fd76
|
HADOOP-12104. Migrate Hadoop Pipes native build to new CMake framework (Alan Burlison via Colin P. McCabe)
|
2015-06-29 12:31:26 -07:00 |
Amareshwari Sriramadasu
|
8ef07f767f
|
HADOOP-11203. Allow ditscp to accept bandwitdh in fraction MegaBytes. Contributed by Raju Bairishetti
|
2015-06-26 09:52:06 +05:30 |
|
cnauroth
|
c45784bc90
|
HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on EOF. Contributed by Ivan Mitic.
|
2015-06-08 22:42:14 -07:00 |
Andrew Wang
|
2dbc40e608
|
HADOOP-12059. S3Credentials should support use of CredentialProvider. Contributed by Sean Busbey.
|
2015-06-05 13:11:01 -07:00 |
|
Robert Kanter
|
cc70df98e7
|
MAPREDUCE-5965. Hadoop streaming throws error if list of input files is high. Error is: "error=7, Argument list too long at if number of input file is high" (wilfreds via rkanter)
|
2015-06-03 18:41:45 -07:00 |
|
cnauroth
|
94e7d49a6d
|
HADOOP-11959. WASB should configure client side socket timeout in storage client blob request options. Contributed by Ivan Mitic.
|
2015-05-28 12:31:06 -07:00 |
|
Colin Patrick Mccabe
|
7dba7005b7
|
HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe)
|
2015-05-26 12:15:46 -07:00 |
Vinod Kumar Vavilapalli
|
500a1d9c76
|
YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev.
|
2015-05-26 11:38:35 -07:00 |
|
Colin Patrick Mccabe
|
f34638399a
|
HADOOP-11927. Fix "undefined reference to dlopen" error when compiling libhadooppipes (Xianyin Xin via Colin P. McCabe)
|
2015-05-22 12:51:03 -07:00 |
|
Akira Ajisaka
|
4aa730ce85
|
HADOOP-11698. Remove DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula.
|
2015-05-20 19:25:45 +09:00 |
Jing Zhao
|
0790275f05
|
HADOOP-1540. Support file exclusion list in distcp. Contributed by Rich Haase.
|
2015-05-18 13:24:35 -07:00 |
|
Akira Ajisaka
|
f5c48238d5
|
HADOOP-11939. Deprecate DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula.
|
2015-05-18 16:13:16 +09:00 |
|
cnauroth
|
cb8e69a80c
|
HADOOP-11960. Enable Azure-Storage Client Side logging. Contributed by Dushyanth.
|
2015-05-14 22:22:24 -07:00 |
|
Akira Ajisaka
|
92c38e41e1
|
HADOOP-9723. Improve error message when hadoop archive output path already exists. Contributed by Jean-Baptiste Onofré and Yongjun Zhang.
|
2015-05-13 17:28:57 +09:00 |
|
Allen Wittenauer
|
ed0f4db0dd
|
HADOOP-11775. Fix Javadoc typos in hadoop-openstack module (Yanjun Wang via aw)
|
2015-05-08 17:01:08 -07:00 |
|
Akira Ajisaka
|
c5afe444df
|
HDFS-8349. Remove .xml and documentation references to dfs.webhdfs.enabled. Contributed by Ray Chiang.
|
2015-05-08 15:57:13 +09:00 |
|
Vinayakumar B
|
f33efbc827
|
HADOOP-11922. Misspelling of threshold in log4j.properties for tests in hadoop-tools (Contributed by Gabor Liptak)
|
2015-05-08 10:22:11 +05:30 |
Jonathan Eagles
|
2d7363b273
|
HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles)
|
2015-05-01 13:11:50 -05:00 |
|
Akira Ajisaka
|
f384a063a6
|
HADOOP-11821. Fix findbugs warnings in hadoop-sls. Contributed by Brahma Reddy Battula.
|
2015-04-30 19:34:41 +09:00 |
|
Allen Wittenauer
|
618ba707f0
|
MAPREDUCE-6057. Remove obsolete entries from mapred-default.xml (Ray Chiang via aw)
|
2015-04-26 20:31:40 -07:00 |
Ravi Prakash
|
a287d2fb77
|
HADOOP-11876. Refactor code to make it more readable, minor maybePrintStats bug (Zoran Dimitrijevic via raviprak)
|
2015-04-24 13:39:07 -07:00 |
|
Steve Loughran
|
19262d99eb
|
HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel)
|
2015-04-23 21:41:51 +01:00 |
|
Ravi Prakash
|
cfba355052
|
HADOOP-11827. Speed-up distcp buildListing() using threadpool (Zoran Dimitrijevic via raviprak)
|
2015-04-21 16:49:37 -07:00 |
|
Jing Zhao
|
4c097e473b
|
HDFS-8151. Always use snapshot path as source when invalid snapshot names are used for diff based distcp. Contributed by Jing Zhao.
|
2015-04-15 12:37:20 -07:00 |
|
Akira Ajisaka
|
83979e61a4
|
MAPREDUCE-6307. Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval. Contributed by J.Andreina.
|
2015-04-10 20:21:00 +09:00 |
|
Colin Patrick Mccabe
|
932730df7d
|
HADOOP-11785. Reduce the number of listStatus operation in distcp buildListing (Zoran Dimitrijevic via Colin P. McCabe)
|
2015-04-03 14:08:25 -07:00 |
|
Haohui Mai
|
75cb1d42ab
|
HDFS-8036. Use snapshot path as source when using snapshot diff report in DistCp. Contributed by Jing Zhao.
|
2015-04-01 16:50:59 -07:00 |
|
Harsh J
|
27d49e6714
|
MAPREDUCE-6291. Correct mapred queue usage command. Contributed by Brahma Reddy Battula.
|
2015-03-28 11:58:17 +05:30 |
|
Tsuyoshi Ozawa
|
e074952bd6
|
HADOOP-11760. Fix typo of javadoc in DistCp. Contributed by Brahma Reddy Battula.
|
2015-03-27 23:15:51 +09:00 |