1693 Commits

Author SHA1 Message Date
Colin Patrick Mccabe
e5f9703419 HADOOP-12100. ImmutableFsPermission should not override applyUmask since that method doesn't modify the FsPermission (Bibin A. Chundatt via Colin P. McCabe)
(cherry picked from commit 6e0a9f92fe0052d39b95a605174b3f6423c6aae7)
(cherry picked from commit 2946e92f79a73cccf9533f31ad40471046496cb2)
2015-06-18 11:39:54 -07:00
Tsz-Wo Nicholas Sze
632cb542f6 HDFS-8361. Choose SSD over DISK in block placement. 2015-06-15 17:29:33 -07:00
Arpit Agarwal
105cadb421 HADOOP-12078. The default retry policy does not handle RetriableException correctly. (Contributed by Arpit Agarwal) 2015-06-09 20:58:55 -07:00
Akira Ajisaka
718dca4859 HADOOP-12058. Fix dead links to DistCp and Hadoop Archives pages. Contributed by Kazuho Fujii.
(cherry picked from commit dbed757cbaf3ddff0c9ae2d905d42828aadedf2a)
(cherry picked from commit 1cccd1eeb3c1c22f570f657ba1eb80a9a37b1496)
2015-06-05 01:47:01 +09:00
cnauroth
7489b128db HADOOP-11934. Use of JavaKeyStoreProvider in LdapGroupsMapping causes infinite loop. Contributed by Larry McCay.
(cherry picked from commit 860b8373c3a851386b8cd2d4265dd35e5aabc941)
(cherry picked from commit 33648268ce0f79bf51facafa3d151612e3d00ddb)
2015-05-28 15:02:10 -07:00
Arun Suresh
273d2f9753 HADOOP-11973. Ensure ZkDelegationTokenSecretManager namespace znodes get created with ACLs. (Gregory Chanan via asuresh)
(cherry picked from commit fd3cb533d2495ea220ab2e468835a43a784d7532)
2015-05-19 11:37:57 -07:00
cnauroth
82530ba0f1 HADOOP-11966. Variable cygwin is undefined in hadoop-config.sh when executed through hadoop-daemon.sh. Contributed by Chris Nauroth.
(cherry picked from commit ddc4afeff256e124ce4291c7a2bab37ad55c8e5c)
2015-05-13 12:26:02 -07:00
Zhijie Shen
071e21cacd YARN-3539. Updated timeline server documentation and marked REST APIs evolving. Contributed by Steve Loughran.
(cherry picked from commit fcd0702c10ce574b887280476aba63d6682d5271)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-05-12 21:19:33 -07:00
Tsuyoshi Ozawa
919cbc19e9 HADOOP-9658. SnappyCodec#checkNativeCodeLoaded may unexpectedly fail when native code is not loaded. Contributed by Zhijie Shen.
(cherry picked from commit 76fa606e2d3d04407f2f6b4ea276cce0f60db4be)
2015-05-04 17:06:08 +09:00
Wangda Tan
3389bac42a YARN-3006. Improve the error message when attempting manual failover with auto-failover enabled. (Akira AJISAKA via wangda)
(cherry picked from commit 7d46a806e71de6692cd230e64e7de18a8252019d)
(cherry picked from commit 4151e5729a1ed74ac94035d66876b2dcc52eaaaf)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-05-01 16:47:06 -07:00
Colin Patrick Mccabe
472fd563e4 HDFS-8213. DFSClient should use hdfs.client.htrace HTrace configuration prefix rather than hadoop.htrace (cmccabe)
(cherry picked from commit b82567d45507c50d2f28eff4bbdf3b1a69d4bf1b)
(cherry picked from commit 9edea9507db2566cf465a77953320b1349859486)
2015-05-01 11:52:08 -07:00
Arun Suresh
91db060ccc HADOOP-11891. OsSecureRandom should lazily fill its reservoir (asuresh)
(cherry picked from commit f0db797be28ca221d540c6a3accd6bff9a7996fa)
2015-04-30 14:03:18 -07:00
Colin Patrick Mccabe
496afb5e1a HADOOP-11802. DomainSocketWatcher thread terminates sometimes after there is an I/O error during requestShortCircuitShm (cmccabe)
(cherry picked from commit a0e0a63209b5eb17dca5cc503be36aa52defeabd)
(cherry picked from commit 788b76761d5dfadf688406d50169e95401fe5d33)
2015-04-23 19:09:50 -07:00
cnauroth
37673268ef HADOOP-11872. "hadoop dfs" command prints message about using "yarn jar" on Windows(branch-2 only). Contributed by Varun Vasudev.
(cherry picked from commit d1253f695df67ff27963d8ea4734b8a9aa79565b)
2015-04-23 13:11:11 -07:00
Arpit Agarwal
b17d365fa1 HDFS-8163. Using monotonicNow for block report scheduling causes test failures on recently restarted systems. (Arpit Agarwal) 2015-04-21 11:17:27 -07:00
Arpit Agarwal
cc42ad03d9 HDFS-8179. DFSClient#getServerDefaults returns null within 1 hour of system start. (Contributed by Xiaoyu Yao) 2015-04-20 15:42:58 -07:00
Haohui Mai
d665d11f99 HADOOP-11815. HttpServer2 should destroy SignerSecretProvider when it stops. Contributed by Rohith. 2015-04-09 10:58:31 -07:00
cnauroth
c6ad39e406 HADOOP-11796. Skip TestShellBasedIdMapping.testStaticMapUpdate on Windows. Contributed by Xiaoyu Yao.
(cherry picked from commit bd77a7c4d94fe8a74b36deb50e19396c98b8908e)
(cherry picked from commit 6e70611819e81eb0690dda00b9789ed250f3959c)
2015-04-07 14:47:52 -07:00
cnauroth
aa326086cc HADOOP-11787. OpensslSecureRandom.c pthread_threadid_np usage signature is wrong on 32-bit Mac. Contributed by Kiran Kumar M R.
(cherry picked from commit a3a96a07faf0c6f6aa3ed33608271c2b1657e437)
(cherry picked from commit 726024faa5c14bcdb31ee3ca9afd6a700e813f7f)
2015-04-01 11:40:25 -07:00
Haohui Mai
530c2ef91a HADOOP-11754. RM fails to start in non-secure mode due to authentication filter failure. Contributed by Haohui Mai. 2015-03-30 11:45:11 -07:00
cnauroth
b849a519cb HADOOP-11639. Clean up Windows native code compilation warnings related to Windows Secure Container Executor. Contributed by Remus Rusanu.
(cherry picked from commit 3836ad6c0b3331cf60286d134157c13985908230)
(cherry picked from commit eb7068c2c9c7edafe283c1ee235a6b940ecf568c)
2015-03-27 15:03:59 -07:00
cnauroth
ae6a76d4da HADOOP-11691. X86 build of libwinutils is broken. Contributed by Kiran Kumar M R.
(cherry picked from commit af618f23a70508111f490a24d74fc90161cfc079)
(cherry picked from commit 36371cddd1a6e109fbb58042897f337b772c777b)
2015-03-26 21:57:43 -07:00
cnauroth
cf2bda8b76 HADOOP-11257. Update "hadoop jar" documentation to warn against using it for launching yarn jars, addendum to print warning to stderr. Contributed by Masatake Iwasaki.
(cherry picked from commit 1fd350fa8ed83e7b99830ec7adf1b02a36c0c11e)
2015-03-26 21:48:48 -07:00
Arpit Agarwal
c808d5fe55 HDFS-7824. GetContentSummary API and its namenode implementation for Storage Type Quota/Usage. (Contributed by Xiaoyu Yao) 2015-03-26 10:48:03 -07:00
Haohui Mai
28095c26f7 HADOOP-10670. Allow AuthenticationFilters to load secret from signature secret files. Contributed by Kai Zheng. 2015-03-25 12:30:58 -07:00
Tsuyoshi Ozawa
557dfe5c40 HADOOP-11014. Potential resource leak in JavaKeyStoreProvider due to unclosed stream. (ozawa)
(cherry picked from commit b351086ff66ca279c0550e078e3a9d110f3f36a5)
2015-03-25 17:00:07 +09:00
Tsuyoshi Ozawa
913fdea4e2 HADOOP-11609. Correct credential commands info in CommandsManual.html#credential. Contributed by Varun Saxena.
(cherry picked from commit 6e891a921e00b122390a976dfd13838472a7fcc6)
2015-03-24 20:58:13 +09:00
Haohui Mai
7129287efb HADOOP-10703. HttpServer2 creates multiple authentication filters. Contributed by Benoy Antony. 2015-03-18 22:33:24 -07:00
Tsuyoshi Ozawa
51c374ac19 HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA.
(cherry picked from commit ef9946cd52d54200c658987c1dbc3e6fce133f77)
2015-03-17 16:09:54 +09:00
Colin Patrick Mccabe
03b979b8a5 HADOOP-11714. Add more trace log4j messages to SpanReceiverHost (cmccabe)
(cherry picked from commit bf3275dbaa99105d49520e25f5a6eadd6fd5b7ed)
(cherry picked from commit eb4eb63de3b929d154360e20abb895f0e14134cf)
2015-03-16 18:41:51 -07:00
cnauroth
389b28033a HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux. Contributed by Kiran Kumar M R.
(cherry picked from commit 72cd4e4a4eb2a9f8695d4c67eb55dd2be36c52dc)
2015-03-16 14:07:05 -07:00
yliu
5eac0a9ec0 HADOOP-11710. Make CryptoOutputStream behave like DFSOutputStream wrt synchronization. (Sean Busbey via yliu)
(cherry picked from commit 813c93cb250d6d556604fe98845b979970bd5e18)
2015-03-15 14:20:18 +09:00
Haohui Mai
245f7b2a77 HADOOP-11633. Convert remaining branch-2 .apt.vm files to markdown. Contributed by Masatake Iwasaki. 2015-03-11 14:31:16 -07:00
cnauroth
0fe5f5b5b8 HDFS-7491. Add incremental blockreport latency to DN metrics. Contributed by Ming Ma.
(cherry picked from commit fb34f45727e63ea55377fe90241328025307d818)
(cherry picked from commit 5e99b7cd2fdf49803703f00463754aa6c56a52a8)
2015-03-11 14:12:06 -07:00
Gera Shegalov
3abf6681be DelegateToFileSystem erroneously uses default FS's port in constructor. (Brahma Reddy Battula via gera) 2015-03-10 14:38:39 -07:00
Tsuyoshi Ozawa
28f4e6b222 HADOOP-11602. Backport 'Fix toUpperCase/toLowerCase to use Locale.ENGLISH.' (ozawa)
(cherry picked from commit b46f9e72dbed6fd1f8cae1e12973252462d6ee15)
2015-03-09 19:54:45 +09:00
Jian He
6cef2c16de YARN-2190. Added CPU and memory limit options to the default container executor for Windows containers. Contributed by Chuan Liu
(cherry picked from commit 21101c01f242439ec8ec40fb3a9ab1991ae0adc7)
2015-03-06 14:18:56 -08:00
yliu
b569c3ab1c HADOOP-11674. oneByteBuf in CryptoInputStream and CryptoOutputStream should be non static. (Sean Busbey via yliu) 2015-03-05 06:39:58 +08:00
Tsuyoshi Ozawa
f805d48b19 HADOOP-11648. Set DomainSocketWatcher thread name explicitly. Contributed by Liang Xie.
(cherry picked from commit 74a4754d1c790b8740a4221f276aa571bc5dbfd5)
2015-03-05 16:06:37 +09:00
Karthik Kambatla
0d62e94887 YARN-3242. Asynchrony in ZK-close can lead to ZKRMStateStore watcher receiving events for old client. (Zhihai Xu via kasha)
(cherry picked from commit 8d88691d162f87f95c9ed7e0a569ef08e8385d4f)
2015-03-04 19:49:21 -08:00
Akira Ajisaka
31b3f84601 HADOOP-11666. Revert the format change of du output introduced by HADOOP-6857. Contributed by Byron Wong. 2015-03-03 21:46:28 -08:00
Steve Loughran
824c32de1a HADOOP-11183. Memory-based S3AOutputstream. (Thomas Demoor via stevel) 2015-03-03 16:18:39 -08:00
Gera Shegalov
5e235802de HADOOP-11605. FilterFileSystem#create with ChecksumOpt should propagate it to wrapped FS. (gera)
(cherry picked from commit b18d3830aca00f44d31e42839578f24eecedf2c8)
2015-03-02 18:16:58 -08:00
Akira Ajisaka
fcd817afb0 HADOOP-11658. Externalize io.compression.codecs property. Contributed by Kai Zheng.
(cherry picked from commit 0650e1c56f2d87ca9bdc51d7d4678895f494464a)
2015-03-02 01:13:10 -08:00
Akira Ajisaka
c40293c828 HADOOP-11615. Update ServiceLevelAuth.md for YARN. Contributed by Brahma Reddy Battula.
(cherry picked from commit dd9cd0797c265edfa7c3f18d2efce7c8f2801a6d)
2015-03-01 22:16:59 -08:00
Tsuyoshi Ozawa
3854b21c4c HADOOP-11634. Description of webhdfs' principal/keytab should switch places each other. Contributed by Brahma Reddy Battula.
(cherry picked from commit e9ac88aac77dd98508854de445793c2180466ee8)
2015-03-02 04:18:39 +09:00
Tsuyoshi Ozawa
02df51497f HADOOP-11569. Provide Merge API for MapFile to merge multiple similar MapFiles to one MapFile. Contributed by Vinayakumar B.
(cherry picked from commit 48c7ee7553af94a57952bca03b49c04b9bbfab45)
2015-02-27 17:46:29 +09:00
cnauroth
264c96777e HADOOP-9922. hadoop windows native build will fail in 32 bit machine. Contributed by Kiran Kumar M R.
(cherry picked from commit 2214dab60ff11b8de74c9d661585452a078fe0c1)
2015-02-26 12:41:48 -08:00
Andrew Wang
0512e50d6e HADOOP-11620. Add support for load balancing across a group of KMS for HA. Contributed by Arun Suresh.
(cherry picked from commit 71385f9b70e22618db3f3d2b2c6dca3b1e82c317)
2015-02-25 21:17:44 -08:00
Tsuyoshi Ozawa
75fd43be02 HADOOP-11632. Cleanup Find.java to remove SupressWarnings annotations. Contributed by Akira AJISAKA.
(cherry picked from commit ad8ed3e802782a7a3fb3d21c5862673a8f695372)
2015-02-25 16:25:21 +09:00