2784 Commits

Author SHA1 Message Date
Akira Ajisaka
c25ab5814c HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen.
(cherry picked from commit 643227927a7d7974655627d7e97aae42600692ae)
(cherry picked from commit 38ec290455a61a53f1f2c8fcc06f914de52fd5e2)
2016-01-25 14:00:03 +09:00
Akira Ajisaka
d228bf1de3 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 736eb17a796a1c1ad5f4db2c6a64f6752db7bec3)
(cherry picked from commit 4edd7bd82094dd8c1474a912532e6373cedf79c9)
2016-01-25 13:48:46 +09:00
Kihwal Lee
330876689b HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma.
(cherry picked from commit b5db1d44104a8ac4c3643cc3ac841f75f31c8345)
2016-01-22 09:20:39 -06:00
Akira Ajisaka
2097016ab1 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki.
(cherry picked from commit 0bae506c221f9736d08a6fba00ce5a862ab43cce)
(cherry picked from commit 6368d102b993e2bda08272ed368b9be912c0abbe)
2016-01-22 21:09:23 +09:00
Xiaoyu Yao
67f711edba HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu.
(cherry picked from commit f3427d3766d7101d0d1c37d6281918551d221ebe)
2016-01-21 13:56:09 -08:00
Akira Ajisaka
68509ae839 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey.
(cherry picked from commit 2ac39ca762fd7e47b7b9a7b3308b31138b0f59be)
(cherry picked from commit cd5c66b080b7b60050a5d39be48163ad9e650ef0)
2016-01-22 02:46:04 +09:00
Vinayakumar B
a02fab85ee HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal)
(cherry picked from commit 446987e20aacd870e1bc3f950b2bd4bbda1f9571)
(cherry picked from commit c13929b385cf2eddcf580b242ffef1f88b7c5d40)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-21 20:14:31 +05:30
Colin Patrick Mccabe
de5175d216 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)
(cherry picked from commit b2c155f810888480d058512a326a5083e1bb4eaa)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/CompileMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/TestMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/util/Exec.java
2016-01-21 16:04:05 +05:30
Lei Xu
b4b5468152 HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu)
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
2016-01-20 14:35:59 -08:00
Ravi Prakash
a359dc87d4 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano
(cherry picked from commit 1acc509b45d58c0eb7e83ea1ba13169410be0dbe)
(cherry picked from commit 2cbb8bbd728aab6d438c3051c970e4b4475b8e68)
2016-01-19 14:01:51 -08:00
Wangda Tan
5dc2e78c97 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
(cherry picked from commit 89d1fd5dac4bccf42d82686e146b02eb60d14736)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-19 21:31:35 +08:00
Akira Ajisaka
ca22066582 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki.
(cherry picked from commit 92c5f565fd5466eab4496c2413de2e8b2897a91f)
(cherry picked from commit 3a8d372518aefe3d25fc9107ae0220d6de8fa736)
2016-01-19 13:32:54 +09:00
cnauroth
ffc0d98886 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth.
(cherry picked from commit 8bc93db2e7c64830b6a662f28c8917a9eef4e7c9)
(cherry picked from commit 62d616621134cc5e68f4d5fd32f49ea4d731417c)
2016-01-18 09:13:31 -08:00
cnauroth
23d729f841 HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay.
(cherry picked from commit 06f4ac0ccdc623283106f258644148d5e003f75c)
(cherry picked from commit 9600736d89fc8e55d39a31dac00a33755a58888c)
2016-01-18 09:09:56 -08:00
Ravi Prakash
5468c40fe7 HADOOP-12689. S3 filesystem operations stopped working correctly
(cherry picked from commit 2d16f40dab291a29b3fc005221b12fd587615d4e)
(cherry picked from commit 6330683778d684d539ae756226f62728776cc1d7)
2016-01-15 15:19:15 -08:00
Akira Ajisaka
8a23379283 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit f0b1b531734bf0699f48ba0bd00ddc9a0a821493)
2016-01-15 10:58:20 +09:00
Akira Ajisaka
91c1736b7a Correct the section of HADOOP-12590 in CHANGES.txt. 2016-01-15 10:53:16 +09:00
Steve Loughran
1fc36b824c HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel)
(cherry picked from commit 80734bc346e8d339a2427b4f691365298acf062c)
2016-01-15 10:41:56 +09:00
Jason Lowe
4ab508ead4 HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe
(cherry picked from commit cdf88952599a43b1ef5adda792bfb195c7529fad)
2016-01-14 23:48:12 +00:00
Jason Lowe
fe77cb1df0 Update CHANGES.txt for commit of HADOOP-12107 to branch-2.7 and branch-2.6
(cherry picked from commit 651c23e8ef8aeafd999249ce57b31e689bd2ece6)
2016-01-14 23:43:09 +00:00
Benoy Antony
6cfeb84a36 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony) 2016-01-14 14:42:04 -08:00
Yongjun Zhang
a7d33b934a Revert "HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge."
This reverts commit b3fa190297cf81d909adb2aeca2868b4fc77c9e9.
2016-01-14 13:06:03 -08:00
Akira Ajisaka
b3fa190297 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit 722d9e569ee6891e71274e758474063f25f5babf)
2016-01-15 00:32:07 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
7eb63d4e7c HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa)
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753dab836105247945392ad4e43695a50bc)
2016-01-13 14:56:35 -08:00
cnauroth
c3f4cb927a HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang.
(cherry picked from commit d64cec0fdaddbb892d66ecff358f547b939005f1)
(cherry picked from commit 2605e78e44493a99a466a9264bf47f44176811ba)
2016-01-12 15:42:00 -08:00
Lei Xu
39f07295fb HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei)
(cherry picked from commit 126705f67eaa6d866f7572fbddf133c5d7552353)
2016-01-12 12:21:00 -08:00
Akira Ajisaka
3fced13eae HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
(cherry picked from commit 6f80be98758ff5d53a192f86ada6cc4062fcdef8)
2016-01-12 13:35:03 +09:00
cnauroth
e26f702866 HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
(cherry picked from commit 0e76f1fceaaaeb66bdb4818f43b9a55fc092bf79)
(cherry picked from commit 813841e10bf9ac30481852bb5aeacc98921bb41c)
2016-01-09 22:18:30 -08:00
cnauroth
f0f8e3ee7c HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
(cherry picked from commit f0fa6d869b9abb5a900ea1c9eb4eb19ec9831dc4)
(cherry picked from commit debd13387daad868de466586370846c32040b7ad)
2016-01-08 20:19:18 -08:00
Steve Loughran
092901345e HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:36 +00:00
cnauroth
506a517f9f HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
(cherry picked from commit 978bbdfeb2d12efd6e750da6a14849e072fb814b)
(cherry picked from commit 4753676a34c4a3de29f9d20281de09533b73ce53)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-06 11:17:01 -08:00
Yongjun Zhang
f372d3faae HADOOP-12604. Exception may be swallowed in KMSClientProvider. (Yongjun Zhang)
(cherry picked from commit 28bd138018bea6fc9c3bfb94c7a4143420f02ced)
2016-01-05 11:19:39 -08:00
Uma Mahesh
68ee13e4f5 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng
(cherry picked from commit 778146eaae5b1e17928a1f26fb1e46536a6ee510)
2016-01-04 15:14:14 -08:00
Akira Ajisaka
a319df412f HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi.
(cherry picked from commit 1af2917856f8da3ad76bb6cbbc511627a647e091)
(cherry picked from commit 40b41ac8fc1aed679d2cd45794c4fb47bdafa9b2)
2016-01-04 20:33:57 +09:00
Akira Ajisaka
22ac1a1ac0 Set release date for 2.6.3
(cherry picked from commit db99e30f670cb5d73d5ec79671026eeeaf337d3d)
(cherry picked from commit 247ab92464beb55bad58b6e63eeac1a41767f432)
2016-01-04 16:13:06 +09:00
Akira Ajisaka
13a48f6256 HADOOP-11252. RPC client does not time out by default. Contributed by Wilfred Spiegelenburg and Masatake Iwasaki.
(cherry picked from commit 64ae85fd2ea91f46ab3b21f007befbeef8c3c947)
(cherry picked from commit d98cfe611f7cedc58cdecfb5a83829adb2521138)
2016-01-04 14:32:21 +09:00
Xiaoyu Yao
c16e126d16 HADOOP-12608. Fix exception message in WASB when connecting with anonymous credential. Contributed by Dushyanth.
(cherry picked from commit 007a8decc61750720033e06b6d08861ac3788e41)
2015-12-30 11:16:06 -08:00
Xiaoyu Yao
a48fdc1907 HADOOP-12682. Fix TestKMS#testKMSRestart* failure. Contributed by Wei-Chiu Chuang.
(cherry picked from commit ab725cff66e8a047e9437e42ac49ac8685ee7a94)
2015-12-30 10:44:13 -08:00
Xiaoyu Yao
beec7a2efb HADOOP-12559. KMS connection failures should trigger TGT renewal. Contributed by Zhe Zhang.
(cherry picked from commit 993311e547e6dd7757025d5ffc285019bd4fc1f6)
2015-12-28 10:47:20 -08:00
Akira Ajisaka
c60792e6e5 HADOOP-12681. start-build-env.sh fails in branch-2. Contributed by Kengo Seki.
(cherry picked from commit babe025fb0a5c0e2822bdb6766fa8b3f71f5f7e6)
2015-12-28 14:39:51 +09:00
Akira Ajisaka
1cd85efd71 HDFS-9505. HDFS Architecture documentation needs to be refreshed. Contributed by Masatake Iwasaki.
(cherry picked from commit fa544020f6f71ee993f047c9b986c047a25ed84c)
(cherry picked from commit 7526a2a005621e2d1d5eed6561fcd1b05ad20037)
2015-12-21 21:23:40 +09:00
Chris Douglas
4150d08a4b HADOOP-12636. Prevent ServiceLoader failure init for unused FileSystems. Contributed by Inigo Goiri
(cherry picked from commit 8652cce5b21825f6f835e4ea31de82eb59fb06c1)
(cherry picked from commit d984ba4fd73df64b7dca1ec10b35956e4ae9bd57)
2015-12-18 18:31:36 -08:00
cnauroth
d6f1d3b6ca HADOOP-12570. HDFS Secure Mode Documentation updates. Contributed by Arpit Agarwal.
(cherry picked from commit 932956458dddabd9583b911c693386a56d723c0d)
(cherry picked from commit dd91cf9fa51df11c80f52e6845555bb9f2b8acef)
2015-12-18 16:54:36 -08:00
Xiaoyu Yao
f3ee0e7857 HDFS-8831. Trash Support for deletion in HDFS encryption zone. Contributed by Xiaoyu Yao.
(cherry picked from commit cbc7b6bf97a80c39d4bbb3005e42dacae6726baf)
(cherry picked from commit eb7f9901b4355c5488172dc93f734ee496b3e4dc)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-12-18 16:34:43 -08:00
Jian He
f355645ca4 YARN-4405. Support node label store in non-appendable file system. Contributed by Wangda Tan
(cherry picked from commit 755dda8dd8bb23864abc752bad506f223fcac010)

(cherry picked from commit be404e168060c03a33a35c8d30925e317a64cad7)
2015-12-18 16:34:42 -08:00
Arpit Agarwal
cef21b7aaa HADOOP-12656. MiniKdc throws "address in use" BindException. (Contributed by Wei-Chiu Chuang) 2015-12-18 16:08:22 -08:00
Zhe Zhang
65effb76d9 HDFS-9347. Invariant assumption in TestQuorumJournalManager.shutdown() is wrong. Contributed by Wei-Chiu Chuang.
Change-Id: Idde8522e11c77f82b376e0c90a9bf33d163d5cb9
2015-12-18 16:06:42 -08:00
Akira Ajisaka
e09d026105 HADOOP-12657. Add a option to skip newline on empty files with getMerge -nl. Contributed by Kanaka Kumar Avvaru.
(cherry picked from commit 061c05cc05ff6257b14c5c4f25cbcec2d184cda7)
(cherry picked from commit af498234997d68b718abed2be7638819e93f2266)
2015-12-18 14:00:42 +09:00
Akira Ajisaka
c18bf20154 HADOOP-12588. Fix intermittent test failure of TestGangliaMetrics. Contributed by Masatake Iwasaki.
(cherry picked from commit bd5e207432c54cc75fd8c040e232241678987e53)
(cherry picked from commit e06c291245902a6014770134443140eb78048240)
2015-12-18 13:13:12 +09:00
Vinod Kumar Vavilapalli
753c9292c2 HADOOP-12415. Fixed pom files to correctly include compile-time dependency on netty. (Tom Zeng via cos)
Addendum commit to include CHANGES.txt entry.

(cherry picked from commit ce16541c62728f69634111dc2ddb321690d3d29b)
2015-12-16 14:42:09 -08:00