Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,760 Commits 326 Branches 371 Tags
Commit Graph

309 Commits

Author SHA1 Message Date
cnauroth
b83d475252 HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth. 
(cherry picked from commit 3da0bedaec38714a62c3b7244e84bc4f981ddf45)
 2015-08-05 14:56:54 -07:00
Lei Xu
f7b0f292e7 HADOOP-12269. Update aws-sdk dependency to 1.10.6 (Thomas Demoor via Lei (Eddy) Xu) 
(cherry picked from commit d5403747b57b1e294e533ce17f197e7be8f5339c)
 2015-08-04 18:56:07 -07:00
cnauroth
bb080b32d4 HADOOP-12239. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit efa97243ecb84b3b468e732897cd685e3869f480)
 2015-07-22 11:17:00 -07:00
Vinayakumar B
03d68b5575 HADOOP-12017. Hadoop archives command should use configurable replication factor when closing (Contributed by Bibin A Chundatt) 
(cherry picked from commit 94c6a4aa85e7d98e9b532b330f30783315f4334b)
 2015-07-22 10:27:03 +05:30
Wangda Tan
3dd113fa7c YARN-2003. Support for Application priority : Changes in RM and Capacity Scheduler. (Sunil G via wangda) 
(cherry picked from commit c39ca541f498712133890961598bbff50d89d68b)
 2015-07-21 09:57:53 -07:00
Vinayakumar B
8ef3821356 HADOOP-12214. Parse 'HadoopArchive' commandline using cli Options. (Contributed by Vinayakumar B) 
(cherry picked from commit 87f29c6b8acc07cc011713a79554d51945e265ac)
 2015-07-21 13:13:31 +05:30
Steve Loughran
f3296a1984 HADOOP-12235 hadoop-openstack junit & mockito dependencies should be "provided". (Ted Yu via stevel) 2015-07-20 11:22:22 +01:00
Chris Douglas
c6b0bbabc7 HADOOP-12211. Collect disk usage on the node. Contributed by Robert Grandl 
(cherry picked from commit a431ed9075cf6f467be5ff10f4ffb131cb1d3216)
 2015-07-13 15:36:25 -07:00
Ming Ma
b169889f01 YARN-3445. Cache runningApps in RMNode for getting running apps on given NodeId. (Junping Du via mingma) 
(cherry picked from commit 08244264c0583472b9c4e16591cfde72c6db62a2)
 2015-07-10 08:34:01 -07:00
Chris Douglas
66419d3672 HADOOP-12210. Collect network usage on the node. Contributed by Robert Grandl 
(cherry picked from commit 1a0752d85a15499d120b4a79af9bd740fcd1f8e0)
 2015-07-09 17:48:56 -07:00
Robert Kanter
3f79ee7494 HADOOP-12159. Move DistCpUtils#compareFs() to org.apache.hadoop.fs.FileUtil and fix for HA namespaces (rchiang via rkanter) 
(cherry picked from commit aaafa0b2ee64f6cfb7fdc717500e1c483b9df8cc)
 2015-06-30 16:50:42 -07:00
cnauroth
399df10c58 HADOOP-12089. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu. 
(cherry picked from commit 460e98f7b3ec84f3c5afcb2aad4f4e7031d16e3a)
 2015-06-29 13:49:12 -07:00
Colin Patrick Mccabe
df58fdaf21 HADOOP-12104. Migrate Hadoop Pipes native build to new CMake framework (Alan Burlison via Colin P. McCabe) 
(cherry picked from commit 5a27c3fd7616215937264c2b1f015205e60f2d73)
 2015-06-29 12:31:43 -07:00
cnauroth
f5b0cce7fa HADOOP-12073. Azure FileSystem PageBlobInputStream does not return -1 on EOF. Contributed by Ivan Mitic. 
(cherry picked from commit c45784bc9031353b938f4756473937cca759b3dc)
 2015-06-08 22:42:24 -07:00
Andrew Wang
83a97907cc HADOOP-12059. S3Credentials should support use of CredentialProvider. Contributed by Sean Busbey. 
(cherry picked from commit 2dbc40e6086026ef02747223982aa68f2d328ade)
 2015-06-05 13:11:12 -07:00
Robert Kanter
ee3002933a MAPREDUCE-5965. Hadoop streaming throws error if list of input files is high. Error is: "error=7, Argument list too long at if number of input file is high" (wilfreds via rkanter) 
(cherry picked from commit cc70df98e74142331043a611a3bd8a53ff6a2242)
 2015-06-03 18:42:16 -07:00
cnauroth
39f451e721 HADOOP-11959. WASB should configure client side socket timeout in storage client blob request options. Contributed by Ivan Mitic. 
(cherry picked from commit 94e7d49a6dab7e7f4e873dcca67e7fcc98e7e1f8)

Conflicts:
	hadoop-project/pom.xml
 2015-05-28 12:32:55 -07:00
Colin Patrick Mccabe
3dec58dd78 HADOOP-11969. ThreadLocal initialization in several classes is not thread safe (Sean Busbey via Colin P. McCabe) 
(cherry picked from commit 7dba7005b79994106321b0f86bc8f4ea51a3c185)
 2015-05-26 12:40:41 -07:00
Vinod Kumar Vavilapalli
a67cb4826b YARN-160. Enhanced NodeManager to automatically obtain cpu/memory values from underlying OS when configured to do so. Contributed by Varun Vasudev. 
(cherry picked from commit 500a1d9c76ec612b4e737888f4be79951c11591d)
 2015-05-26 11:39:40 -07:00
Colin Patrick Mccabe
97ebe1b2cf HADOOP-11927. Fix "undefined reference to dlopen" error when compiling libhadooppipes (Xianyin Xin via Colin P. McCabe) 
(cherry picked from commit f34638399abdca2e6d3bc5502508819dd747861c)
 2015-05-22 12:57:29 -07:00
Jing Zhao
5caea4cd46 HADOOP-1540. Support file exclusion list in distcp. Contributed by Rich Haase. 
(cherry picked from commit 0790275f058b0cf41780ad337c9150a1e8ebebc6)
 2015-05-18 13:26:09 -07:00
Akira Ajisaka
b26d99c394 HADOOP-11939. Deprecate DistCpV1 and Logalyzer. Contributed by Brahma Reddy Battula. 
(cherry picked from commit f5c48238d5eb0c1d2b876f390ac6c35221efcb54)
 2015-05-18 16:14:19 +09:00
cnauroth
91855c2340 HADOOP-11960. Enable Azure-Storage Client Side logging. Contributed by Dushyanth. 
(cherry picked from commit cb8e69a80cecb95abdfc93a787bea0bedef275ed)
 2015-05-14 22:22:46 -07:00
Akira Ajisaka
b9a92c4452 HADOOP-9723. Improve error message when hadoop archive output path already exists. Contributed by Jean-Baptiste Onofré and Yongjun Zhang. 
(cherry picked from commit 92c38e41e1fffb9d60d4fa5d4d2212777af9e9a5)
 2015-05-13 17:30:49 +09:00
Vinayakumar B
14d88a85e4 HADOOP-11922. Misspelling of threshold in log4j.properties for tests in hadoop-tools (Contributed by Gabor Liptak) 
(cherry picked from commit f33efbc82709e75d9b4c4ed9835629668dbade7d)
 2015-05-08 10:23:27 +05:30
Jonathan Eagles
9ed6b77da1 HADOOP-11889. Make checkstyle runnable from root project (Gera Shegalov via jeagles) 
(cherry picked from commit 2d7363b27360e36fdd62546c0f9d0b1d78133f29)

Conflicts:
	pom.xml
 2015-05-01 19:04:41 -07:00
Akira Ajisaka
47ba08a119 HADOOP-11821. Fix findbugs warnings in hadoop-sls. Contributed by Brahma Reddy Battula. 
(cherry picked from commit f384a063a653b33d69f7d2c7d4fd45c24b5aa46a)
 2015-04-30 19:49:32 +09:00
Ravi Prakash
122262a1fb HADOOP-11876. Refactor code to make it more readable, minor maybePrintStats bug (Zoran Dimitrijevic via raviprak) 2015-04-24 13:39:48 -07:00
Steve Loughran
a6a5d1d6b5 HADOOP-11730. Regression: s3n read failure recovery broken. (Takenori Sato via stevel) 2015-04-23 21:39:43 +01:00
Ravi Prakash
aa34aa5caa HADOOP-11827. Speed-up distcp buildListing() using threadpool (Zoran Dimitrijevic via raviprak) 2015-04-21 16:50:40 -07:00
Jing Zhao
d4dd97eabd HDFS-8151. Always use snapshot path as source when invalid snapshot names are used for diff based distcp. Contributed by Jing Zhao. 
(cherry picked from commit 4c097e473bb1f18d1510deb61bae2bcb8c156f18)
 2015-04-15 12:39:09 -07:00
Akira Ajisaka
f603b9ccca MAPREDUCE-6307. Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval. Contributed by J.Andreina. 
(cherry picked from commit 83979e61a49daa67a05eed1ba64c24d31a41610a)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2015-04-10 20:23:46 +09:00
Colin Patrick Mccabe
386b90a700 HADOOP-11785. Reduce the number of listStatus operation in distcp buildListing (Zoran Dimitrijevic via Colin P. McCabe) 
(cherry picked from commit 932730df7d62077f7356464ad27f69469965d77a)
 2015-04-03 14:08:53 -07:00
Haohui Mai
9e114ee607 HDFS-8036. Use snapshot path as source when using snapshot diff report in DistCp. Contributed by Jing Zhao. 2015-04-01 16:51:09 -07:00
Harsh J
274db918c3 MAPREDUCE-6291. Correct mapred queue usage command. Contributed by Brahma Reddy Battula. 
(cherry picked from commit f5432cb47dfacaa57faed32a29d00bbeff8a5385)
 2015-03-28 11:58:44 +05:30
Tsuyoshi Ozawa
24b60a7d1a HADOOP-11760. Fix typo of javadoc in DistCp. Contributed by Brahma Reddy Battula. 
(cherry picked from commit e074952bd6bedf58d993bbea690bad08c9a0e6aa)
 2015-03-27 23:16:37 +09:00
Yongjun Zhang
be0d228ed1 HADOOP-11724. DistCp throws NPE when the target directory is root. (Lei Eddy Xu via Yongjun Zhang) 
(cherry-picked from commit 65ee02d9ed50e026c2d37ec80babd4176075ff84)
 2015-03-25 15:50:28 -07:00
Harsh J
d85c14afbf MAPREDUCE-579. Streaming slowmatch documentation. 
(cherry picked from commit a2e42d2deee715f6255d6fd2c95f34e80888dc5f)
 2015-03-25 14:39:46 +05:30
Harsh J
c58786794b MAPREDUCE-4653. TestRandomAlgorithm has an unused import statement. Contributed by Amir Sanjar. 
(cherry picked from commit 75e4670408a058efa95eaa768fedbe614008658f)
 2015-03-17 14:13:23 +05:30
Tsuyoshi Ozawa
77297017d8 HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA. 
(cherry picked from commit ef9946cd52d54200c658987c1dbc3e6fce133f77)
 2015-03-17 16:09:38 +09:00
Tsuyoshi Ozawa
4489a02634 HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Jean-Pierre Matsumoto. 
(cherry picked from commit 79426f3334ade5850fbf169764f540ede00fe366)
 2015-03-15 14:30:12 +09:00
Tsuyoshi Ozawa
1802df8373 Revert "HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Masatake Iwasaki." 
This reverts commit 54a73a6b5fd085456020d3564187e03a0ef41033.
 2015-03-15 14:27:56 +09:00
Tsuyoshi Ozawa
54a73a6b5f HADOOP-11558. Fix dead links to doc of hadoop-tools. Contributed by Masatake Iwasaki. 
(cherry picked from commit 7da136ecca4dafc83ef69b5d9980fa5b67ada084)
 2015-03-15 14:18:01 +09:00
cnauroth
dcc4850ff3 HADOOP-11693. Azure Storage FileSystem rename operations are throttled too aggressively to complete HBase WAL archiving. Contributed by Duo Xu. 
(cherry picked from commit 7a346bcb4fa5b56191ed00a39e72e51c9bdf1b56)
 2015-03-11 14:37:22 -07:00
Haohui Mai
e75e6c66ea HADOOP-11633. Convert remaining branch-2 .apt.vm files to markdown. Contributed by Masatake Iwasaki. 2015-03-11 14:23:44 -07:00
Tsuyoshi Ozawa
b46f9e72db HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa) 2015-03-09 19:53:55 +09:00
Vinod Kumar Vavilapalli
d9416317a9 Preparing for 2.8.0 development. Changing SNAPSHOT version to be 2.8 on branch-2. 2015-03-08 20:32:51 -07:00
Tsuyoshi Ozawa
ccde4aed18 MAPREDUCE-5657. Backport '[JDK8] Fix Javadoc errors caused by incorrect or illegal tags in doc comments.' Contributed by Akira AJISAKA. 2015-03-09 12:00:04 +09:00
Steve Loughran
b8a2087951 HADOOP-11670. Regression: s3a auth setup broken. (Adam Budde via stevel) 2015-03-08 11:22:01 -07:00
cnauroth
02cadbd24b HADOOP-11642. Upgrade azure sdk version from 0.6.0 to 2.0.0. Contributed by Shashank Khandelwal and Ivan Mitic. 
(cherry picked from commit 608ebd52bafecf980e9726d397c786a9c2422eba)

Conflicts:
	hadoop-project/pom.xml
 2015-03-06 15:29:22 -08:00