Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,890 Commits 326 Branches 371 Tags
Commit Graph

12890 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
John Zhuge
74fbdd557a HDFS-11561. HttpFS doc errors. Contributed by Yuanbo Liu. 
(cherry picked from commit ed2d03f2a5318a88d0eced8476127f303eb1d1d9)
 2017-03-22 22:16:34 -07:00
Daniel Templeton
d4bba011cc YARN-6284. hasAlreadyRun should be final in ResourceManager.StandByTransitionRunnable 
(Contributed by Laura Adams via Daniel Templeton)

(cherry picked from commit 0a05c5c5989edeba2cffe16e80350245778cefce)
 2017-03-21 14:27:27 -07:00
Junping Du
dabe96a72e YARN-6367. YARN logs CLI needs alway check containerLogsInfo/containerLogInfo before parse the JSON object from NMWebService. Contributed by Xuan Gong. 
(cherry picked from commit c01d15ab2731b6710c94ff3bfa37d496a87b0c9f)

Conflicts:

	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/LogsCLI.java
 2017-03-21 10:55:19 -07:00
John Zhuge
84e2c11f96 HADOOP-14205. No FileSystem for scheme: adl. Contributed by John Zhuge. 2017-03-21 08:23:30 -07:00
Steve Loughran
b4481fef41
HADOOP-14204 S3A multipart commit failing, 
"UnsupportedOperationException at java.util.Collections$UnmodifiableList.sort".

Contributed by Steve Loughran

(cherry picked from commit 595501c9ddacd5fdb740ac1bf9bfeb0ffbbd6c0e)
 2017-03-21 13:14:43 +00:00
John Zhuge
2c5de0c60e HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane 
(cherry picked from commit 19f373a46b2abb7a575f7884a9c7443b8ed67cd3)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java
 2017-03-20 21:16:50 -07:00
Chris Douglas
69f34e812e HDFS-6648. Order of namenodes in ConfiguredFailoverProxyProvider is undefined. Contributed by Inigo Goiri 
(cherry picked from commit b104f3a282ab8e15314446e71189eb3a3b5dd9a6)
 2017-03-20 17:16:15 -07:00
Mingliang Liu
22930b09a0 HADOOP-13945. Azure: Add Kerberos and Delegation token support to WASB client. Contributed by Santhosh G Nayak 
Change-Id: I39fb0a3b0491bf2160571366939a0502a0045429
(cherry picked from commit 8e15e240597f821968e14893eabfea39815de207)
 2017-03-20 16:37:57 -07:00
Daniel Templeton
f7177d91d6 YARN-6309. Fair scheduler docs should have the queue and queuePlacementPolicy 
elements listed in bold so that they're easier to see
(Contributed by Esmaeil Mirzaee via Daniel Templeton)

(cherry picked from commit 948afe2c92977d6924a62c1a5a1ffca315cd3e68)
 2017-03-20 14:32:01 -07:00
Arpit Agarwal
90e3283a0a HADOOP-14059. typo in s3a rename(self, subdir) error message. Contributed by Steve Loughran. 2017-03-20 11:29:30 -07:00
Varun Saxena
e2cabb4d21 YARN-6353. Clean up OrderingPolicy javadoc (Daniel Templeton via Varun Saxena) 
(cherry picked from commit 35034653d02ac8156338d7267e5975d2d66272d5)
 2017-03-20 23:51:15 +05:30
Naganarasimha
0cfa6ec6c8 MAPREDUCE-6865. Fix typo in javadoc for DistributedCache. Contributed by Attila Sasvari. 
(cherry picked from commit 34a931c0fa5853fbcaadf0211d6bbee881715748)
 2017-03-20 08:26:05 +05:30
Arpit Agarwal
5d7197b2e6 HDFS-11547. Add logs for slow BlockReceiver while writing data to disk. Contributed by Xiaobing Zhou. 2017-03-17 19:03:41 -07:00
Erik Krogen
e44569b736 HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen. 
(cherry picked from commit e1a99802fc5c2f2ad3ceb000378db1c0133069b3)
 2017-03-17 17:40:14 -07:00
Arpit Agarwal
2b4b85e06f HDFS-11517. Include missed change in previous commit. 2017-03-17 16:12:53 -07:00
Hanisha Koneru
dbd673d516 HDFS-11517. Expose slow disks via DataNode JMX. Contributed by Hanisha Koneru 2017-03-17 15:50:00 -07:00
Jason Lowe
75e6b7428e YARN-6217. TestLocalCacheDirectoryManager test timeout is too aggressive. Contributed by Miklos Szegedi 
(cherry picked from commit 4a8e3045027036afebbcb80f23b7a2886e56c255)
 2017-03-17 14:07:48 -05:00
Andrew Wang
7cc88eca43 HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki. 
(cherry picked from commit 92ea6d74ecd84b86771e285902dd2a80bccbe3ea)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/util/ErasureCodingCliCmdExecutor.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testErasureCodingConf.xml
 2017-03-17 11:34:43 -07:00
Xiaobing Zhou
dbdd97d057 HDFS-10394. move declaration of okhttp version from hdfs-client to hadoop-project POM. Contributed by Xiaobing Zhou. 2017-03-16 18:13:55 -07:00
Junping Du
6c11a75821 Revert "Update document to reflect new features of ADL support in 2.8.0 release." 
This reverts commit a95bf8db0717c12288c95e66d19c5fe4a750e8de.
 2017-03-16 13:25:33 -07:00
Junping Du
a95bf8db07 Update document to reflect new features of ADL support in 2.8.0 release. 
(cherry picked from commit 91f2b7a13d1e97be65db92ddabc627cc29ac0009)
 2017-03-16 13:24:23 -07:00
Junping Du
c51507dde0 Revert "Revert "HDFS-11431. hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider."" 
This reverts commit b0baabc24952c043517796d7ba64ce1a28337f12.
 2017-03-16 12:44:11 -07:00
Jitendra Pandey
d564d1f44d HDFS-11533. reuseAddress option should be used for child channels in Portmap and SimpleTcpServer. Contributed by Mukul Kumar Singh. 2017-03-16 12:37:22 -07:00
Andrew Wang
b0baabc249 Revert "HDFS-11431. hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider." 
This reverts commit 3eaa79c9cf7556d166165b35117d0b47f0514a68.
 2017-03-16 12:25:03 -07:00
Kihwal Lee
a264d98017 HDFS-10601. Improve log message to include hostname when the NameNode is in safemode. Contributed by Kuhu Shukla. 
(cherry picked from commit ba62b50ebacd33b55eafc9db55a2fe5b4c80207a)
 2017-03-16 11:02:48 -05:00
Jason Lowe
a16ba4296e YARN-4051. ContainerKillEvent lost when container is still recovering and application finishes. Contributed by sandflee 2017-03-16 09:31:20 -05:00
Steve Loughran
3eaa79c9cf
HDFS-11431. hadoop-hdfs-client JAR does not include ConfiguredFailoverProxyProvider. 
Contributed by Steven Rand.

(cherry picked from commit b59dd4c79824280616641408b538e90f10eb49f8)
 2017-03-16 14:08:02 +00:00
Jian He
9f9ccb2784 YARN-6332. Make RegistrySecurity use short user names for ZK ACLs. Contributed by Billie Rinaldi 2017-03-16 13:00:44 +08:00
Junping Du
8b31ff6dba YARN-6294. ATS client should better handle Socket closed case. Contributed by Li Lu. 2017-03-15 11:49:51 -07:00
Yiqun Lin
c0e061b410 HDFS-11420. Edit file should not be processed by the same type processor in OfflineEditsViewer. Contributed by Yiqun Lin. 2017-03-15 22:37:25 +08:00
Sunil G
caaa6fa96b YARN-6328. Fix a spelling mistake in CapacityScheduler. Contributed by Jin Yibo. This closes #202 
(cherry picked from commit 2d0e24eb01cec6f4554671b54729717510711c63)
 2017-03-15 14:58:20 +05:30
Mingliang Liu
ed0d426a88 HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu 2017-03-14 15:00:59 -07:00
Ray Chiang
fa59f4e490 YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang) 2017-03-14 14:45:13 -07:00
Junping Du
0e7879052a YARN-6313. YARN logs cli should provide logs for a completed container even when application is still running. Contributed by Xuan Gong. 
(cherry picked from commit b88f5e0f7858d1d89b79dfd325b767c34416052d)
 2017-03-14 12:58:41 -07:00
Junping Du
f254002f1d YARN-6314. Potential infinite redirection on YARN log redirection web service. Contributed by Xuan Gong. 
(cherry picked from commit 5a9dda796f0e73060ada794ad5752cc6a237ab2e)
 2017-03-14 02:58:44 -07:00
Yiqun Lin
f731013c88 HDFS-11526. Fix confusing block recovery message. Contributed by Yiqun Lin. 2017-03-14 17:52:31 +08:00
Jing Zhao
e03d8ff488 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. 
(cherry picked from commit 55796a0946f80a35055701a34379e374399009c5)
 2017-03-13 14:26:44 -07:00
John Zhuge
0da850a472 HADOOP-14173. Remove unused AdlConfKeys#ADL_EVENTS_TRACKING_SOURCE. Contributed by John Zhuge. 
Change-Id: I5dc6f885816b8834f718874542dfa373458b0333
(cherry picked from commit 5a40bafdaeec693e613aa02e79dbaaccfdab6f60)
 2017-03-13 08:36:46 -07:00
Yiqun Lin
7a65601dd9 HDFS-11512. Increase timeout on TestShortCircuitLocalRead#testSkipWithVerifyChecksum. Contributed by Eric Badger. 
(cherry picked from commit 79924266f8f68e5e7c873e6b12e3b3acfcd708da)
 2017-03-13 18:24:50 +08:00
Lei Xu
ee1d3105c2 HDFS-11340. DataNode reconfigure for disks doesn't remove the failed volumes. (Manoj Govindassamy via lei) 2017-03-10 14:37:58 -08:00
Mingliang Liu
0d9030b732 HADOOP-14153. ADL module has messed doc structure. Contributed by Mingliang Liu 
(cherry picked from commit 881ec4d97bd1db4582027aec3a4204156a4eda17)
 2017-03-10 13:22:24 -08:00
Steve Loughran
851c0df5d3 HADOOP-14113. Review ADL Docs. Contributed by Steve Loughran 
(cherry picked from commit e60c6543d57611039b0438d5dcb4cb19ee239bb6)
 2017-03-10 13:22:02 -08:00
Jason Lowe
ef95e74eb1 YARN-6321. TestResources test timeouts are too aggressive. Contributed by Eric Badger 
(cherry picked from commit 9649c27864a23ea156bae904368c1d3cf94c6e9d)
 2017-03-10 13:07:20 -06:00
Jian He
8c44a9db21 HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-10 09:26:19 -08:00
Jason Lowe
1a0358b59a YARN-6310. OutputStreams in AggregatedLogFormat.LogWriter can be left open upon exceptions. Contributed by Haibo Chen 
(cherry picked from commit deb9f569465bb760e661e60a313dad1605635236)
 2017-03-10 11:09:04 -06:00
Mingliang Liu
9ea6b24c49 HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 
(cherry picked from commit fd26783aaf3deea7a4e197439bd1075a6689681f)
 2017-03-10 00:21:58 -08:00
Karthik Kambatla
4218671f3c YARN-6264. AM not launched when a single vcore is available on the cluster. (Yufei Gu via kasha) 
(cherry picked from commit a96afae125ba02fb4480542d3fb0891623ee4c37)
 2017-03-09 23:16:19 -08:00
John Zhuge
f298b992f4 HADOOP-14123. Remove misplaced ADL service provider config file for FileSystem. Contributed by John Zhuge. 
Change-Id: Ic956e2eb8189625916442eaffdc69163d32f730e
(cherry picked from commit c5ee7fded46dcb1ac1ea4c1ada4949c50bc89afb)
 2017-03-09 19:53:23 -08:00
Daniel Templeton
c60cd88ad1 YARN-1047. Expose # of pre-emptions as a queue counter (Contributed by Karthik Kambatla via Daniel Templeton) 2017-03-09 18:18:03 -08:00
Daniel Templeton
6774f9c3c2 YARN-6300. NULL_UPDATE_REQUESTS is redundant in TestFairScheduler (Contributed by Yuanbo Liu via Daniel Templeton) 
(cherry picked from commit 8bc8804be1b96f8a4fc33b5d24dd7f7af93a437e)
 2017-03-09 17:53:24 -08:00