2799 Commits

Author SHA1 Message Date
cnauroth
44c6277d01 HADOOP-12752. Improve diagnostics/use of envvar/sysprop credential propagation. Contributed by Steve Loughran.
(cherry picked from commit cf3261570ae139c177225af165557038a9280a5d)
(cherry picked from commit a76611d4ec8f78faae436d7bdff31f4ae6d0d6fd)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-02-08 09:36:58 -08:00
Steve Loughran
f4bcc76df6 HADOOP-12292. Make use of DeleteObjects optional. (Thomas Demoor via stevel) 2016-02-06 18:17:30 +00:00
cnauroth
be115634f2 HADOOP-12426. Add Entry point for Kerberos health check. Contributed by Steve Loughran.
(cherry picked from commit cfa8513890ec1cd7f71258ff3c3083f6d89a4fc4)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/conf/hadoop-env.sh

(cherry picked from commit 4db6cc44cd1f1b2692ad3fdc18798cf5f32250ec)
2016-02-05 15:52:26 -08:00
cnauroth
e01d8393b6 HADOOP-12758. Extend CSRF Filter with UserAgent Checks. Contributed by Larry McCay.
(cherry picked from commit a37e423e8407c42988577d87907d13ce0432dda1)
(cherry picked from commit 5752df23622495cd288747e61b3644c4137251db)
2016-02-05 14:38:40 -08:00
Kihwal Lee
150240cce0 HADOOP-12772. NetworkTopologyWithNodeGroup.getNodeGroup() can loop infinitely for invalid 'loc' values. Contributed by Kuhu Shukla.
(cherry picked from commit 49e176c29f95c179c0f6b07d4d582e6a771a96bd)
2016-02-05 15:48:32 -06:00
Colin Patrick Mccabe
4fb2a098f4 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe)
(cherry picked from commit 9086dd58c3fc391ffdc017a913e56d1801040c7a)
(cherry picked from commit 86760c0f528ed50cf6211ba6592f6f226b085b90)
2016-02-05 10:58:39 -08:00
Xiaoyu Yao
740a1385d2 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou.
(cherry picked from commit 5d00067ca7f1460bbda1330e7329205a7b1ce019)
2016-02-05 10:41:02 -08:00
Xuan
acd90c6819 YARN-4662. Document some newly added metrics. Contributed by Jian He
(cherry picked from commit 63c63e298cf9ff252532297deedde15e77323809)
(cherry picked from commit dfad608b22b5b90f4a13a14fc8786c24c7dacbb9)
2016-02-03 20:06:57 -08:00
Sangjin Lee
b49ac969bc HADOOP-12761. incremental maven build is not really incremental (sjlee)
(cherry picked from commit 4dc0a3949386ce2961356143a5a843dd537829dc)
2016-02-03 09:02:02 -08:00
Junping Du
847158811b Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:36:39 -08:00
Andrew Wang
1d15c90233 HADOOP-12755. Fix typo in defaultFS warning message.
(cherry picked from commit 8171874dd198a6d10f48211f311595b222e6b930)
(cherry picked from commit b4ad58796b70954804ad96f0c15381ad13e7a8ea)
2016-02-02 11:57:00 -08:00
Colin Patrick Mccabe
bc00b8ce9e HADOOP-12735. core-default.xml misspells hadoop.workaround.non.threadsafe.getpwuid (Ray Chiang via cmccabe)
(cherry picked from commit 2e8ab3d46568162af6aa90b612ed61d487e7c7b0)
(cherry picked from commit b94fbdf6f080a95ad8f2d787bc8e219e8eeea0f6)
2016-01-27 11:40:59 -08:00
Yongjun Zhang
62206dd2ed HADOOP-12718. Incorrect error message by fs -put local dir without permission. (John Zhuge via Yongjun Zhang)
(cherry picked from commit 97056c3355810a803f07baca89b89e2bf6bb7201)
2016-01-27 08:05:33 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
3efc72ccd5 Release process for 2.7.2: Set the release date for 2.7.2
(cherry picked from commit ec4d2d9f40c1cb52ca4561b3d010ffc046a73495)
2016-01-25 15:47:39 -08:00
Walter Su
26673b312d HADOOP-12715. TestValueQueue#testgetAtMostPolicyALL fails intermittently. Contributed by Xiao Chen.
(cherry picked from commit 6eacdea0e475b4fff91cedce5005a7c11749cf64)
2016-01-25 19:43:21 +08:00
Akira Ajisaka
c25ab5814c HADOOP-12736. TestTimedOutTestsListener#testThreadDumpAndDeadlocks sometimes times out. Contributed by Xiao Chen.
(cherry picked from commit 643227927a7d7974655627d7e97aae42600692ae)
(cherry picked from commit 38ec290455a61a53f1f2c8fcc06f914de52fd5e2)
2016-01-25 14:00:03 +09:00
Akira Ajisaka
d228bf1de3 HADOOP-12731. Remove useless boxing/unboxing code. Contributed by Kousuke Saruta.
(cherry picked from commit 736eb17a796a1c1ad5f4db2c6a64f6752db7bec3)
(cherry picked from commit 4edd7bd82094dd8c1474a912532e6373cedf79c9)
2016-01-25 13:48:46 +09:00
Kihwal Lee
330876689b HDFS-8898. Create API and command-line argument to get quota and quota usage without detailed content summary. Contributed by Ming Ma.
(cherry picked from commit b5db1d44104a8ac4c3643cc3ac841f75f31c8345)
2016-01-22 09:20:39 -06:00
Akira Ajisaka
2097016ab1 HADOOP-12730. Hadoop streaming -mapper and -reducer options are wrongly documented as required. Contributed by Kengo Seki.
(cherry picked from commit 0bae506c221f9736d08a6fba00ce5a862ab43cce)
(cherry picked from commit 6368d102b993e2bda08272ed368b9be912c0abbe)
2016-01-22 21:09:23 +09:00
Xiaoyu Yao
67f711edba HADOOP-12659. Incorrect usage of config parameters in token manager of KMS. Contributed by Mingliang Liu.
(cherry picked from commit f3427d3766d7101d0d1c37d6281918551d221ebe)
2016-01-21 13:56:09 -08:00
Akira Ajisaka
68509ae839 HADOOP-7161. Remove unnecessary oro package from dependency management section. Contributed by Sean Busbey.
(cherry picked from commit 2ac39ca762fd7e47b7b9a7b3308b31138b0f59be)
(cherry picked from commit cd5c66b080b7b60050a5d39be48163ad9e650ef0)
2016-01-22 02:46:04 +09:00
Vinayakumar B
a02fab85ee HADOOP-12423. Handle failure of registering shutdownhook by ShutdownHookManager in static block (Contributed by Abhishek Agarwal)
(cherry picked from commit 446987e20aacd870e1bc3f950b2bd4bbda1f9571)
(cherry picked from commit c13929b385cf2eddcf580b242ffef1f88b7c5d40)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-21 20:14:31 +05:30
Colin Patrick Mccabe
de5175d216 HADOOP-12712. Fix some cmake plugin and native build warnings (cmccabe)
(cherry picked from commit b2c155f810888480d058512a326a5083e1bb4eaa)

 Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/CompileMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/cmakebuilder/TestMojo.java
	hadoop-maven-plugins/src/main/java/org/apache/hadoop/maven/plugin/util/Exec.java
2016-01-21 16:04:05 +05:30
Lei Xu
b4b5468152 HDFS-9655. NN should start JVM pause monitor before loading fsimage. (John Zhuge via Lei (Eddy) Xu)
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java
2016-01-20 14:35:59 -08:00
Ravi Prakash
a359dc87d4 HADOOP-12696. Add tests for S3FileSystem Contract. Contributed by Matt Paduano
(cherry picked from commit 1acc509b45d58c0eb7e83ea1ba13169410be0dbe)
(cherry picked from commit 2cbb8bbd728aab6d438c3051c970e4b4475b8e68)
2016-01-19 14:01:51 -08:00
Wangda Tan
5dc2e78c97 HADOOP-12356. Fix computing CPU usage statistics on Windows. (Inigo Goiri via wangda)
(cherry picked from commit 89d1fd5dac4bccf42d82686e146b02eb60d14736)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-19 21:31:35 +08:00
Akira Ajisaka
ca22066582 HDFS-9623. Update example configuration of block state change log in log4j.properties. Contributed by Masatake Iwasaki.
(cherry picked from commit 92c5f565fd5466eab4496c2413de2e8b2897a91f)
(cherry picked from commit 3a8d372518aefe3d25fc9107ae0220d6de8fa736)
2016-01-19 13:32:54 +09:00
cnauroth
ffc0d98886 HADOOP-12635. Adding Append API support for WASB. Contributed by Dushyanth.
(cherry picked from commit 8bc93db2e7c64830b6a662f28c8917a9eef4e7c9)
(cherry picked from commit 62d616621134cc5e68f4d5fd32f49ea4d731417c)
2016-01-18 09:13:31 -08:00
cnauroth
23d729f841 HADOOP-12691. Add CSRF Filter for REST APIs to Hadoop Common. Contributed by Larry McCay.
(cherry picked from commit 06f4ac0ccdc623283106f258644148d5e003f75c)
(cherry picked from commit 9600736d89fc8e55d39a31dac00a33755a58888c)
2016-01-18 09:09:56 -08:00
Ravi Prakash
5468c40fe7 HADOOP-12689. S3 filesystem operations stopped working correctly
(cherry picked from commit 2d16f40dab291a29b3fc005221b12fd587615d4e)
(cherry picked from commit 6330683778d684d539ae756226f62728776cc1d7)
2016-01-15 15:19:15 -08:00
Akira Ajisaka
8a23379283 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit f0b1b531734bf0699f48ba0bd00ddc9a0a821493)
2016-01-15 10:58:20 +09:00
Akira Ajisaka
91c1736b7a Correct the section of HADOOP-12590 in CHANGES.txt. 2016-01-15 10:53:16 +09:00
Steve Loughran
1fc36b824c HADOOP-12590. TestCompressorDecompressor failing without stack traces (John Zhuge via stevel)
(cherry picked from commit 80734bc346e8d339a2427b4f691365298acf062c)
2016-01-15 10:41:56 +09:00
Jason Lowe
4ab508ead4 HADOOP-12706. TestLocalFsFCStatistics#testStatisticsThreadLocalDataCleanUp times out occasionally. Contributed by Sangjin Lee and Colin Patrick McCabe
(cherry picked from commit cdf88952599a43b1ef5adda792bfb195c7529fad)
2016-01-14 23:48:12 +00:00
Jason Lowe
fe77cb1df0 Update CHANGES.txt for commit of HADOOP-12107 to branch-2.7 and branch-2.6
(cherry picked from commit 651c23e8ef8aeafd999249ce57b31e689bd2ece6)
2016-01-14 23:43:09 +00:00
Benoy Antony
6cfeb84a36 HADOOP-12587. Hadoop AuthToken refuses to work without a maxinactive attribute in issued token. (Benoy Antony) 2016-01-14 14:42:04 -08:00
Yongjun Zhang
a7d33b934a Revert "HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge."
This reverts commit b3fa190297cf81d909adb2aeca2868b4fc77c9e9.
2016-01-14 13:06:03 -08:00
Akira Ajisaka
b3fa190297 HADOOP-12700. Remove unused import in TestCompressorDecompressor.java. Contributed by John Zhuge.
(cherry picked from commit f977366d9522ee31080e16db90972729fcfe256f)
(cherry picked from commit 722d9e569ee6891e71274e758474063f25f5babf)
2016-01-15 00:32:07 +09:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
7eb63d4e7c HADOOP-5323. Trash documentation should describe its directory structure and configurations. (Weiwei Yang via ozawa)
Moved entry from HDFS CHANGES.txt to that of common.

(cherry picked from commit cb73c753dab836105247945392ad4e43695a50bc)
2016-01-13 14:56:35 -08:00
cnauroth
c3f4cb927a HADOOP-12603. TestSymlinkLocalFSFileContext#testSetTimesSymlinkToDir occasionally fail. Contributed by Wei-Chiu Chuang.
(cherry picked from commit d64cec0fdaddbb892d66ecff358f547b939005f1)
(cherry picked from commit 2605e78e44493a99a466a9264bf47f44176811ba)
2016-01-12 15:42:00 -08:00
Lei Xu
39f07295fb HADOOP-11262. Enable YARN to use S3A. (Pieter Reuse via lei)
(cherry picked from commit 126705f67eaa6d866f7572fbddf133c5d7552353)
2016-01-12 12:21:00 -08:00
Akira Ajisaka
3fced13eae HADOOP-12584. Disable browsing the static directory in HttpServer2. Contributed by Robert Kanter.
(cherry picked from commit 9c89bcd04212543ae279d34938ec2ad319e5ba6d)
(cherry picked from commit 6f80be98758ff5d53a192f86ada6cc4062fcdef8)
2016-01-12 13:35:03 +09:00
cnauroth
e26f702866 HADOOP-12551. Introduce FileNotFoundException for WASB FileSystem API. Contributed by Dushyanth.
(cherry picked from commit 0e76f1fceaaaeb66bdb4818f43b9a55fc092bf79)
(cherry picked from commit 813841e10bf9ac30481852bb5aeacc98921bb41c)
2016-01-09 22:18:30 -08:00
cnauroth
f0f8e3ee7c HADOOP-12678. Handle empty rename pending metadata file during atomic rename in redo path. Contributed by Madhumita Chakraborty.
(cherry picked from commit f0fa6d869b9abb5a900ea1c9eb4eb19ec9831dc4)
(cherry picked from commit debd13387daad868de466586370846c32040b7ad)
2016-01-08 20:19:18 -08:00
Steve Loughran
092901345e HADOOP-12675. Fix description about retention period in usage of expunge command. (Masatake Iwasaki via stevel) 2016-01-07 14:39:36 +00:00
cnauroth
506a517f9f HADOOP-12634. Change Lazy Rename Pending Operation Completion of WASB to address case of potential data loss due to partial copy. Contributed by Gaurav Kanade.
(cherry picked from commit 978bbdfeb2d12efd6e750da6a14849e072fb814b)
(cherry picked from commit 4753676a34c4a3de29f9d20281de09533b73ce53)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2016-01-06 11:17:01 -08:00
Yongjun Zhang
f372d3faae HADOOP-12604. Exception may be swallowed in KMSClientProvider. (Yongjun Zhang)
(cherry picked from commit 28bd138018bea6fc9c3bfb94c7a4143420f02ced)
2016-01-05 11:19:39 -08:00
Uma Mahesh
68ee13e4f5 HADOOP-12658. Clear javadoc and check style issues around DomainSocket. Contributed by Kai Zheng
(cherry picked from commit 778146eaae5b1e17928a1f26fb1e46536a6ee510)
2016-01-04 15:14:14 -08:00
Akira Ajisaka
a319df412f HADOOP-12686. Update FileSystemShell documentation to mention the meaning of each columns of fs -du. Contributed by Daisuke Kobayashi.
(cherry picked from commit 1af2917856f8da3ad76bb6cbbc511627a647e091)
(cherry picked from commit 40b41ac8fc1aed679d2cd45794c4fb47bdafa9b2)
2016-01-04 20:33:57 +09:00
Akira Ajisaka
22ac1a1ac0 Set release date for 2.6.3
(cherry picked from commit db99e30f670cb5d73d5ec79671026eeeaf337d3d)
(cherry picked from commit 247ab92464beb55bad58b6e63eeac1a41767f432)
2016-01-04 16:13:06 +09:00