7911 Commits

Author SHA1 Message Date
cnauroth
059c4a372f HDFS-7473. Document setting dfs.namenode.fs-limits.max-directory-items to 0 is invalid. Contributed by Akira AJISAKA.
(cherry picked from commit d555bb2120cb44d094546e6b6560926561876c10)
2014-12-08 11:07:18 -08:00
cnauroth
143a5b67d8 HDFS-7384. getfacl command and getAclStatus output should be in sync. Contributed by Vinayakumar B.
(cherry picked from commit ffe942b82c1208bc7b22899da3a233944cb5ab52)
2014-12-08 10:28:25 -08:00
Steve Loughran
275561d848 HADOOP-10530 Make hadoop build on Java7+ only (stevel) 2014-12-08 15:30:34 +00:00
Harsh J
bb1fedfbc3 MAPREDUCE-6177. Minor typo in the EncryptedShuffle document about ssl-client.xml. Contributed by Yangping Wu. (harsh)
(cherry picked from commit 8963515b880b78068791f11abe4f5df332553be1)
2014-12-08 16:00:12 +05:30
Karthik Kambatla
d02cb9c512 YARN-2927. [YARN-1492] InMemorySCMStore properties are inconsistent. (Ray Chiang via kasha)
(cherry picked from commit 120e1decd7f6861e753269690d454cb14c240857)
2014-12-07 22:28:57 -08:00
cnauroth
308b75571b HADOOP-11313. Adding a document about NativeLibraryChecker. Contributed by Tsuyoshi OZAWA.
(cherry picked from commit 1b3bb9e7a33716c4d94786598b91a24a4b29fe67)
2014-12-06 20:12:56 -08:00
cnauroth
00528ad1ad HDFS-7476. Consolidate ACL-related operations to a single class. Contributed by Haohui Mai.
(cherry picked from commit 9297f980c2de8886ff970946a2513e6890cd5552)
2014-12-06 14:20:32 -08:00
Haohui Mai
b65093c733 HDFS-7459. Consolidate cache-related implementation in FSNamesystem into a single class. Contributed by Haohui Mai. 2014-12-05 18:36:04 -08:00
Andrew Wang
dabdd2d746 HADOOP-11343. Overflow is not properly handled in caclulating final iv for AES CTR. Contributed by Jerry Chen.
(cherry picked from commit 0707e4eca906552c960e3b8c4e20d9913145eca6)
2014-12-05 18:20:23 -08:00
Jian He
4cc0abe4fe YARN-2869. CapacityScheduler should trim sub queue names when parse configuration. Contributed by Wangda Tan
(cherry picked from commit e69af836f34f16fba565ab112c9bf0d367675b16)
2014-12-05 17:34:15 -08:00
Jing Zhao
988ef8a462 HDFS-7474. Avoid resolving path in FSPermissionChecker. Contributed by Jing Zhao.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java
2014-12-05 14:20:26 -08:00
Jason Lowe
b72fb6c774 YARN-2056. Disable preemption at Queue level. Contributed by Eric Payne
(cherry picked from commit 4b130821995a3cfe20c71e38e0f63294085c0491)
2014-12-05 21:08:14 +00:00
Robert Kanter
2ebd1bc654 YARN-2461. Fix PROCFS_USE_SMAPS_BASED_RSS_ENABLED property in YarnConfiguration. (rchiang via rkanter)
(cherry picked from commit 3c72f54ef581b4f3e2eb84e1e24e459c38d3f769)
2014-12-05 12:10:20 -08:00
Andrew Wang
b8e4fffa49 HADOOP-11355. When accessing data in HDFS and the key has been deleted, a Null Pointer Exception is shown. Contributed by Arun Suresh.
(cherry picked from commit 9cdaec6a6f6cb1680ad6e44d7b0c8d70cdcbe3fa)
2014-12-05 12:01:32 -08:00
Haohui Mai
6afc75f87b HDFS-7472. Fix typo in message of ReplicaNotFoundException. Contributed by Masatake Iwasaki. 2014-12-05 11:23:32 -08:00
Haohui Mai
2caed865e9 HDFS-7478. Move org.apache.hadoop.hdfs.server.namenode.NNConf to FSNamesystem. Contributed by Li Lu. 2014-12-05 10:55:27 -08:00
Haohui Mai
4f612f148b HADOOP-11356. Removed deprecated o.a.h.fs.permission.AccessControlException. Contributed by Li Lu. 2014-12-05 10:50:03 -08:00
Haohui Mai
b4478f069a HDFS-7454. Reduce memory footprint for AclEntries in NameNode. Contributed by Vinayakumar B. 2014-12-04 20:49:59 -08:00
Karthik Kambatla
aadd0c392b YARN-2189. [YARN-1492] Admin service for cache manager. (Chris Trezzo via kasha)
(cherry picked from commit 78968155d7f87f2147faf96c5eef9c23dba38db8)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/bin/yarn
2014-12-04 19:48:18 -08:00
Haohui Mai
448f925fc0 HDFS-7468. Moving verify* functions to corresponding classes. Contributed by Li Lu. 2014-12-04 14:10:01 -08:00
Colin Patrick Mccabe
a0976152e6 HADOOP-11348. Remove unused variable from CMake error message for finding openssl (Dian Fu via Colin P. McCabe)
(cherry picked from commit 565b0e60a8fc4ae5bc0083cc6a6ddb2d01952f32)
2014-12-04 12:54:59 -08:00
Jian He
1d1e7682c9 YARN-2301. Improved yarn container command. Contributed by Naganarasimha G R
(cherry picked from commit 258623ff8bb1a1057ae3501d4f20982d5a59ea34)
2014-12-04 12:53:52 -08:00
Brandon Li
d4e1f12c5f HDFS-7424. Add web UI for NFS gateway. Contributed by Brandon Li
(cherry picked from commit 1bbcc3d0320b9435317bfeaa078af22d4de8d00c)
2014-12-04 10:47:29 -08:00
Aaron T. Myers
534a021e70 HADOOP-11332. KerberosAuthenticator#doSpnegoSequence should check if kerberos TGT is available in the subject. Contributed by Dian Fu.
(cherry picked from commit 9d1a8f5897d585bec96de32116fbd2118f8e0f95)
2014-12-03 18:54:26 -08:00
Jian He
58c971164c YARN-2880. Added a test to make sure node labels will be recovered if RM restart is enabled. Contributed by Rohith Sharmaks
(cherry picked from commit 73fbb3c66b0d90abee49c766ee9d2f05517cb9de)
2014-12-03 17:17:40 -08:00
Harsh J
ee25c0d890 YARN-2891. Failed Container Executor does not provide a clear error message. Contributed by Dustin Cote. (harsh)
(cherry picked from commit 4b13318dea7a1cbbbfc1f84207af829cbe2f720e)
2014-12-04 03:19:01 +05:30
Karthik Kambatla
25be97808b YARN-2874. Dead lock in DelegationTokenRenewer which blocks RM to execute any further apps. (Naganarasimha G R via kasha)
(cherry picked from commit 799353e2c7db5af6e40e3521439b5c8a3c5c6a51)
2014-12-03 13:45:03 -08:00
Brandon Li
97b3e2b79b HDFS-7458. Add description to the nfs ports in core-site.xml used by nfs test to avoid confusion. Contributed by Yongjun Zhang
(cherry picked from commit a1e822595c3dc5eadbd5430e57bc4691d09d5e68)
2014-12-03 13:32:29 -08:00
Andrew Wang
696e15f0d1 HADOOP-11342. KMS key ACL should ignore ALL operation for default key ACL and whitelist key ACL. Contributed by Dian Fu.
(cherry picked from commit 1812241ee10c0a98844bffb9341f770d54655f52)
2014-12-03 12:00:29 -08:00
Jason Lowe
db723a8499 MAPREDUCE-5932. Provide an option to use a dedicated reduce-side shuffle log. Contributed by Gera Shegalov
(cherry picked from commit 03ab24aa01ffea1cacf1fa9cbbf73c3f2904d981)

Conflicts:

	hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml
2014-12-03 17:12:47 +00:00
Steve Loughran
81ad192730 HDFS-7448 TestBookKeeperHACheckpoints fails in trunk (Akira Ajisaka via stevel) 2014-12-03 12:20:01 +00:00
Junping Du
86535ff65f YARN-1156. Enhance NodeManager AllocatedGB and AvailableGB metrics for aggregation of decimal values. (Contributed by Tsuyoshi OZAWA)
(cherry picked from commit e65b7c5ff6b0c013e510e750fe5cf59acfefea5f)
2014-12-03 04:12:35 -08:00
stack
fe6ee8a3f1 HDFS-6735. A minor optimization to avoid pread() be blocked by read() inside the same DFSInputStream (Lars Hofhansl via stack)
(cherry picked from commit 7caa3bc98e6880f98c5c32c486a0c539f9fd3f5f)
2014-12-02 20:59:45 -08:00
Andrew Wang
c962eef533 HADOOP-11344. KMS kms-config.sh sets a default value for the keystore password even in non-ssl setup. Contributed by Arun Suresh.
(cherry picked from commit 3d48ad7eb424206dd1528179b35de4cdf51afdf3)
2014-12-02 19:04:33 -08:00
Jian He
d6f3d4893d YARN-2894. Fixed a bug regarding application view acl when RM fails over. Contributed by Rohith Sharmaks
(cherry picked from commit 392c3aaea8e8f156b76e418157fa347256283c56)
2014-12-02 17:17:16 -08:00
Colin Patrick Mccabe
06552a15d5 HDFS-7446. HDFS inotify should have the ability to determine what txid it has read up to (cmccabe)
(cherry picked from commit 75a326aaff8c92349701d9b3473c3070b8c2be44)
2014-12-02 17:15:42 -08:00
Haohui Mai
f32af158ed HDFS-7462. Consolidate implementation of mkdirs() into a single class. Contributed by Haohui Mai. 2014-12-02 15:00:19 -08:00
Jian He
5067ac098b YARN-2136. Changed RMStateStore to ignore store opearations when fenced. Contributed by Varun Saxena
(cherry picked from commit 52bcefca8bb13d3757009f1f08203e7dca3b1e16)
2014-12-02 11:02:00 -08:00
stack
6d904985e8 HADOOP-11301. [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)
(cherry picked from commit b36f29298247f6c5db9f6eff7c2f5177a0fe3de5)
2014-12-01 23:08:16 -08:00
stack
76245dfccd Revert "HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)"
This reverts commit fd6a801ddb2d2db83f98e7aab183a6e07ce4890c.

Refers to an HBASE rather than HADOOP issue.
2014-12-01 23:02:32 -08:00
stack
fd6a801ddb HBASE-11301 [optionally] update jmx cache to drop old metrics (Maysam Yabandeh via stack)
(cherry picked from commit 74f4d8590de85eaa92c711010bbc0ff0e33ee2e8)
2014-12-01 22:55:12 -08:00
Andrew Wang
881c77107e HADOOP-11341. KMS support for whitelist key ACLs. Contributed by Arun Suresh.
(cherry picked from commit 31b4d2daa14a7f6e8ee73fd3160e126d8db62ffb)
2014-12-01 21:58:21 -08:00
Colin Patrick Mccabe
f9c5dec152 CHANGES.txt: add HADOOP-11257
(cherry picked from commit c1f2bb2d31d40bda5bb2c5bdf31e4f6e433d1e77)
2014-12-01 21:58:15 -08:00
Haohui Mai
9ce77520a8 HDFS-7438. Consolidate the implementation of rename() into a single class. Contributed by Haohui Mai. 2014-12-01 21:51:16 -08:00
Haohui Mai
49122df1c0 HDFS-7450. Consolidate the implementation of GetFileInfo(), GetListings() and GetContentSummary() into a single class. Contributed by Haohui Mai. 2014-12-01 21:37:44 -08:00
Andrew Wang
084667aad9 HADOOP-11337. KeyAuthorizationKeyProvider access checks need to be done atomically. Contributed by Dian Fu.
(cherry picked from commit 9fa29902575ac3774bf3728e7bcde7f3eefb1d4c)
2014-12-01 21:22:03 -08:00
Zhijie Shen
d21ef79707 YARN-2890. MiniYARNCluster should start the timeline server based on the configuration. Contributed by Mit Desai.
(cherry picked from commit 51af8d367de94689770f57c64bea3b244d7755f6)
2014-12-01 19:08:31 -08:00
Jian He
d208c90148 YARN-2765. Added leveldb-based implementation for RMStateStore. Contributed by Jason Lowe
(cherry picked from commit a7fba0bc28764e0fb36c335ea60cc58079fe007f)
2014-12-01 16:45:17 -08:00
Jason Lowe
b6d7b789bd MAPREDUCE-6160. Potential NullPointerException in MRClientProtocol interface implementation. Contributed by Rohith
(cherry picked from commit 0c588904f8b68cad219d2bd8e33081d5cae656e5)
2014-12-01 22:40:38 +00:00
Jason Lowe
38ea1419f6 YARN-2905. AggregatedLogsBlock page can infinitely loop if the aggregated log file is corrupted. Contributed by Varun Saxena
(cherry picked from commit 0f9528b99addbb0fd9a19d84db22a8c8e934b05f)
2014-12-01 22:30:20 +00:00