8841 Commits

Author SHA1 Message Date
Robert Kanter
a3a7efe748 MAPREDUCE-6143. add configuration for mapreduce speculative execution in MR2 (zxu via rkanter)
(cherry picked from commit 8acc5e9b4b3fea8b418b3526c15022c8a9fedd56)
2015-02-02 13:52:29 -08:00
Tsz-Wo Nicholas Sze
8426c7d806 HDFS-7696. In FsDatasetImpl, the getBlockInputStream(..) and getTmpInputStreams(..) methods may leak file descriptors.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java
2015-02-02 13:42:15 -08:00
Tsz-Wo Nicholas Sze
a5568a276d HDFS-7681. Change ReplicaInputStreams constructor to take InputStream(s) instead of FileDescriptor(s). Contributed by Joe Pallas
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-02-02 13:30:07 -08:00
Tsz-Wo Nicholas Sze
2ecfd018f4 HDFS-5782. Change BlockListAsLongs constructor to take Replica as parameter type instead of concrete classes Block and ReplicaInfo. Contributed by David Powell and Joe Pallas
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-02-02 13:24:02 -08:00
Tsz-Wo Nicholas Sze
e43b1428b4 HDFS-5631. Change BlockMetadataHeader.readHeader(..), ChunkChecksum class and constructor to public; and fix FsDatasetSpi to use generic type instead of FsVolumeImpl. Contributed by David Powell and Joe Pallas 2015-02-02 12:59:22 -08:00
Zhijie Shen
ebaf6220fe YARN-2216. Fixed the change log.
(cherry picked from commit 5f9a0dd8d959e6c03f611c6f073b27a8d73ad418)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2015-02-02 12:16:07 -08:00
Zhijie Shen
b51c0288de YARN-2808. Made YARN CLI list attempt’s finished containers of a running application. Contributed by Naganarasimha G R.
(cherry picked from commit c0ec4f4cc12208342d45236b8841887a20f7f88a)
2015-02-02 12:05:05 -08:00
cnauroth
dedfb982f1 HADOOP-11442. hadoop-azure: Create test jar. Contributed by Shashank Khandelwal.
(cherry picked from commit 1c09ca2ba4d97d827cc6e86ef6bd2930bc77b5ae)
2015-02-02 11:51:01 -08:00
cnauroth
aee297ccea HADOOP-10181. GangliaContext does not work with multicast ganglia setup. Contributed by Andrew Johnson.
(cherry picked from commit 8004a002307940176cc188657c68e85171a5b5a8)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/metrics/ganglia/GangliaContext.java
2015-02-02 11:16:13 -08:00
Kihwal Lee
05d831c4b7 YARN-3113. Release audit warning for Sorting icons.psd. Contributed by Steve Loughran.
(cherry picked from commit f33c99ba3900f21901b479ad6e85f5cd95a9c657)
2015-02-02 12:59:45 -06:00
Benoy Antony
f3ed5b68ca HADOOP-11494. Lock acquisition on WrappedInputStream#unwrappedRpcBuffer may race with another thread. Contributed by Ted Yu.
(cherry picked from commit 3472e3bd6c50558870b86c9ccfea5072385fa991)
2015-02-02 10:46:54 -08:00
Harsh J
648510e031 HADOOP-11488. Difference in default connection timeout for S3A FS. Contributed by Daisuke Kobayashi.
(cherry picked from commit ffc75d6ebe4912f20f4f4870d2a50abbe4557bfa)
2015-02-01 00:17:24 +05:30
Gera Shegalov
151e147e64 HADOOP-11432. Fix SymlinkBaseTest#testCreateLinkUsingPartQualPath2. (Liang Xie via gera)
(cherry picked from commit 26c2de36e2dd1b2ddedc155e49fb2ec31366d5f8)
2015-01-30 18:47:03 -08:00
Jian He
4941b8f30d YARN-3077. Fixed RM to create zk root path recursively. Contributed by Chun Chen
(cherry picked from commit 054a947989d6ccbe54a803ca96dcebeba8328367)
2015-01-30 17:35:26 -08:00
Colin Patrick Mccabe
4bf14876b3 HADOOP-11498 addendum. Fix extra "import" statements in branch-2.7 patch backport 2015-01-30 16:07:12 -08:00
Colin Patrick Mccabe
80381b62aa HADOOP-11498. Bump the version of HTrace to 3.1.0-incubating (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 09ad9a868a89922e9b55b3e7c5b9f41fa54d3770)
2015-01-30 16:02:36 -08:00
Kihwal Lee
3a01984bda HADOOP-9137. Support connection limiting in IPC server. Contributed by Kihwal Lee.
(cherry picked from commit 8dc59cb9e0f8d300991a437c1b42f1e4e495cfe4)
2015-01-30 17:22:48 -06:00
Jian He
cabf97ae4f YARN-3099. Capacity Scheduler LeafQueue/ParentQueue should use ResourceUsage to track used-resources-by-label. Contributed by Wangda Tan
(cherry picked from commit 86358221fc85a7743052a0b4c1647353508bf308)
2015-01-30 15:16:22 -08:00
Andrew Wang
fcd23b61e3 HDFS-7706. Switch BlockManager logging to use slf4j.
(cherry picked from commit 951b3608a8cb1d9063b9be9c740b524c137b816f)
2015-01-30 11:36:02 -08:00
Allen Wittenauer
a754f94ed7 MAPREDUCE-6151. Update document of GridMix (Masatake Iwasaki via aw) 2015-01-30 11:09:03 -08:00
cnauroth
4607ca2854 HADOOP-11523. StorageException complaining " no lease ID" when updating FolderLastModifiedTime in WASB. Contributed by Duo Xu.
(cherry picked from commit f2c91098c400da6db0f5e8e49e9bf0e6444af531)
2015-01-29 17:02:48 -08:00
Colin Patrick Mccabe
e8d154baea HADOOP-11403. Avoid using sys_errlist on Solaris, which lacks support for it (Malcolm Kavalsky via Colin P. McCabe)
(cherry picked from commit e36ef3b4022a8527cdfa937c4ffc9d46e71cfe28)
2015-01-29 15:48:59 -08:00
Jonathan Eagles
d4ffca41d7 YARN-3108. ApplicationHistoryServer doesn't process -D arguments (Chang Li via jeagles)
(cherry picked from commit 30a8778c632c0f57cdd005080a470065a60756a8)
2015-01-29 16:52:37 -06:00
Allen Wittenauer
3165e778f3 MAPREDUCE-6150. Update document of Rumen (Masatake Iwasaki via aw) 2015-01-29 14:18:25 -08:00
cnauroth
fa2378d866 HADOOP-11441. Hadoop-azure: Change few methods scope to public. Contributed by Shashank Khandelwal.
(cherry picked from commit ad55083f75cb920fde58302d7bc8857086c1978c)
2015-01-29 13:07:59 -08:00
Tsuyoshi Ozawa
6efffc9cd8 YARN-3029. FSDownload.unpack() uses local locale for FS case conversion, may not work everywhere. Contributed by Varun Saxena.
(cherry picked from commit 7acce7d3648d6f1e45ce280e2147e7dedf5693fc)
2015-01-30 04:42:25 +09:00
Kihwal Lee
3b030731a0 HDFS-7603. The background replication queue initialization may not let others run. Contributed by Kihwal Lee.
(cherry picked from commit 89b07490f8354bb83a67b7ffc917bfe99708e615)
2015-01-29 12:37:34 -06:00
Akira Ajisaka
1081b4c4a7 HADOOP-9907. Webapp http://hostname:port/metrics link is not working. (aajisaka)
(cherry picked from commit 342efa110af9989829b8a8caa699658a2ba01607)
2015-01-30 02:50:46 +09:00
Akira Ajisaka
7411c74b11 HADOOP-10574. Bump the maven plugin versions too -moving the numbers into properties. (aajisaka)
(cherry picked from commit 57b8950f37f74fc4a046c598c710b19b50ccef1f)

Conflicts:
	pom.xml
2015-01-30 02:27:36 +09:00
Akira Ajisaka
57172c09e2 MAPREDUCE-6231. Grep example job is not working on a fully-distributed cluster. (aajisaka)
(cherry picked from commit fe2188a0420f501ccfcba92e91d4b564ba86103e)
2015-01-30 01:11:22 +09:00
Akira Ajisaka
71c60af84e HADOOP-10525. Remove DRFA.MaxBackupIndex config from log4j.properties (aajisaka)
(cherry picked from commit 03a5e04d5b6ec89219769868466e3b4913b0fff6)
2015-01-29 16:18:07 +09:00
Wangda Tan
58d7d1efc6 YARN-3079. Scheduler should also update maximumAllocation when updateNodeResource. (Zhihai Xu via wangda)
(cherry picked from commit 7882bc0f1433ae73361cab4207eb0c15abee4586)
2015-01-28 21:56:17 -08:00
yliu
dc7950ef18 HDFS-7423. various typos and message formatting fixes in nfs daemon and doc. (Charles Lamb via yliu) 2015-01-29 04:20:14 +08:00
Jian He
43b3b43cea MAPREDUCE-6230. Fixed RMContainerAllocator to update the new AMRMToken service name properly. Contributed by Jason Lowe
(cherry picked from commit cff05bff1fe24628677d41a0d537f2c383b44faf)
2015-01-28 15:52:11 -08:00
Jing Zhao
e8300957a7 HDFS-7611. deleteSnapshot and delete of a file can leave orphaned blocks in the blocksMap on NameNode restart. Contributed by Jing Zhao and Byron Wong.
(cherry picked from commit d244574d03903b0514b0308da85d2f06c2384524)
2015-01-28 15:25:42 -08:00
Jian He
12522fd9cb YARN-3103. AMRMClientImpl does not update AMRM token properly. Contributed by Jason Lowe
(cherry picked from commit 6d2bdbd7dab179dfb4f19bb41809e97f1db88c6b)
2015-01-28 15:24:10 -08:00
Andrew Wang
55bb4eca73 HDFS-6673. Add delimited format support to PB OIV tool. Contributed by Eddy Xu.
(cherry picked from commit caf7298e49f646a40023af999f62d61846fde5e2)
2015-01-28 12:36:44 -08:00
Tsuyoshi Ozawa
71db37266b HADOOP-11316. "mvn package -Pdist,docs -DskipTests -Dtar" fails because of non-ascii characters. (ozawa)
(cherry picked from commit 9850e1584b7bb47c39d777d6fc4931dd54fbaea7)
2015-01-28 22:01:38 +09:00
Tsuyoshi Ozawa
235a77fe1c HADOOP-11317. Increment SLF4J version to 1.7.10. Contributed by Tim Robertson.
(cherry picked from commit 20a4768397a36a21a6e6d9b27b5a81898a5889d9)
2015-01-28 21:55:33 +09:00
Colin Patrick Mccabe
ad865b1cd0 HDFS-7675. Remove unused member DFSClient.spanReceiverHost (cmccabe)
(cherry picked from commit d12dd47f4516fe125221ae073f1bc88b702b122f)
2015-01-27 20:52:53 -08:00
yliu
3ac8f88989 HADOOP-11469. KMS should skip default.key.acl and whitelist.key.acl when loading key acl. (Dian Fu via yliu) 2015-01-27 23:55:52 +08:00
yliu
d483ba25d7 HDFS-7677. DistributedFileSystem#truncate should resolve symlinks. (yliu) 2015-01-27 23:47:52 +08:00
Wangda Tan
4718af4352 YARN-2932. Add entry for preemptable status (enabled/disabled) to scheduler web UI and queue initialize/refresh logging. (Eric Payne via wangda)
(cherry picked from commit 18741adf97f4fda5f8743318b59c440928e51297)
2015-01-27 15:37:02 -08:00
Wangda Tan
12060cb9a6 YARN-3028. Better syntax for replaceLabelsOnNode in RMAdmin CLI. Contributed by Rohith Sharmaks
(cherry picked from commit fd93e5387b554a78413bc0f14b729e58fea604ea)
2015-01-27 15:25:47 -08:00
Allen Wittenauer
874e38d81f HDFS-7566. Remove obsolete entries from hdfs-default.xml (Ray Chiang via aw) 2015-01-27 14:32:21 -08:00
Jonathan Eagles
c95e8951f8 YARN-2897. CrossOriginFilter needs more log statements (Mit Desai via jeagles)
(cherry picked from commit a8ad1e8089e4bf5854085d2d38d1c0133b5a41bc)
2015-01-27 16:07:27 -06:00
Aaron T. Myers
3c8d3816c6 HADOOP-10626. Limit Returning Attributes for LDAP search. Contributed by Jason Hubbard.
(cherry picked from commit 8709751e1ee9a2c5553823dcd715bd077052ad7f)
2015-01-27 13:51:19 -08:00
Jian He
8100c8a68c YARN-3011. Possible IllegalArgumentException in ResourceLocalizationService might lead NM to crash. Contributed by Varun Saxena
(cherry picked from commit 4e15fc08411318e11152fcd5a4648ed1d6fbb480)
2015-01-27 13:31:48 -08:00
Haohui Mai
b3a63fa8a2 HDFS-7683. Combine usages and percent stats in NameNode UI. Contributed by Vinayakumar B. 2015-01-27 11:09:42 -08:00
Haohui Mai
3d6318b51b HADOOP-4297. Enable Java assertions when running tests. Contributed by Tsz Wo Nicholas Sze. 2015-01-27 11:06:15 -08:00