Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
14,150 Commits 326 Branches 371 Tags
Commit Graph

3594 Commits

Author SHA1 Message Date
Daniel Templeton
5225ae50b7 HADOOP-13997. Typo in metrics docs (Contributed by Ana Krasteva via Daniel Templeton) 
(cherry picked from commit d4483a2fe47ccc589e71c6fe5501878e6142c26f)
 2017-04-19 09:42:30 -07:00
Kengo Seki
6cfceee865
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation 
This closes #214

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 654372db859656a2201ae9f9f7c374c6564ea34d)
 2017-04-18 17:15:35 +09:00
Akira Ajisaka
a17bd70892
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu. 
(cherry picked from commit 84a8848aaecd56b4cc85185924c2e33674165e01)
 2017-04-18 16:45:14 +09:00
Mingliang Liu
508389ee54 HADOOP-14255. S3A to delete unnecessary fake directory objects in mkdirs(). Contributed by Mingliang Liu 
(cherry picked from commit 507845074970b90330db86bc1ff0124def550bb5)
 2017-04-12 14:30:54 -07:00
Daniel Templeton
f20aa38a1d HADOOP-14246. Authentication Tokens should use SecureRandom instead of Random and 256 bit secrets 
(Conttributed by Robert Konter via Daniel Templeton)

(cherry picked from commit 4dd6206547de8f694532579e37ba8103bafaeb12)
 2017-04-12 11:19:53 -07:00
Chris Nauroth
d5e2bd4096 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 00ed21a6fedb45a7c8992b8d45adaa83f14af34c)
 2017-04-11 21:18:47 -07:00
Steve Loughran
5efb3ade1f HADOOP-14066 VersionInfo should be marked as public API 
(cherry picked from commit 2ed65540a3fe73db5d2dd0d25e658ccf13c9188a)
 2017-04-11 15:06:40 -07:00
Jason Lowe
0cb22a0f15 YARN-6195. Export UsedCapacity and AbsoluteUsedCapacity to JMX. Contributed by Benson Qiu 
(cherry picked from commit 0e065f2edead41f6f894c9d70def389af1c0f239)
 2017-04-11 08:45:16 -05:00
Andrew Wang
dab1deb9a0 HADOOP-14293. Initialize FakeTimer with a less trivial value. 
(cherry picked from commit be144117a885cb39bc192279c96cbe3790dc77b1)
 2017-04-10 11:37:31 -07:00
John Zhuge
ff2870310e HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge. 
Signed-off-by: John Zhuge <jzhuge@apache.org>
(cherry picked from commit 56e81f2a204d5e65d29222df1b2ba4d892f9c0d5)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/TestCommonConfigurationFields.java
 2017-04-07 15:01:29 -07:00
Zhe Zhang
c85026038a HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen. 
(cherry picked from commit 95b7f1d29a5e2dadd70a56fca5faa006c5bd74fc)
 2017-04-07 10:39:40 -07:00
Andrew Wang
ed8f738be5 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-06 14:38:22 -07:00
Xiaoyu Yao
9016614eb1 HDFS-11302. Improve Logging for SSLHostnameVerifier. Contributed by Chen Liang. 
(cherry picked from commit 32bb36b750ab656f2f32f6c74eaa1a3e68ae956e)
 2017-04-05 18:30:33 -07:00
Jonathan Eagles
60e65a3e55 HADOOP-14216. Addendum to Improve Configuration XML Parsing Performance (jeagles) 2017-03-30 14:15:37 -05:00
Mingliang Liu
3d5e9e61d5 HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu 
(cherry picked from commit 13c766b62c48ae07849f7f1762ef6883239aef54)
 2017-03-29 11:19:28 -07:00
Jonathan Eagles
719ae5f2e8 HADOOP-14216. Improve Configuration XML Parsing Performance (jeagles) 2017-03-29 10:14:49 -05:00
John Zhuge
ef43a62482 HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge. 
(cherry picked from commit 253e3e78abb9ebe0e8103d25538ff07875b33c84)
 2017-03-27 23:07:08 -07:00
Akira Ajisaka
643298b282
HADOOP-14218. Replace assertThat with assertTrue in MetricsAsserts. 
(cherry picked from commit 448ec81fd7133f413853570f116d5f6e16f68bd9)
 2017-03-28 14:33:36 +09:00
Andrew Wang
10deafee82 HDFS-11170. Add builder-based create API to FileSystem. Contributed by SammiChen and Wei Zhou. 2017-03-27 14:35:03 -07:00
Jonathan Eagles
e41aac0cd4 Configuration#get return value optimization (jeagles) 2017-03-27 12:52:59 -05:00
Jonathan Eagles
675bc97f18 Delay construction of PreCondition.check failure message in Configuration#set (jeagles) 
(cherry picked from commit 858d597be00ce006c1d1d4cd476729e4f1de8d25)
 2017-03-27 11:02:41 -05:00
Junping Du
3ad4d37363 Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release. 
(cherry picked from commit 6df029db36412b7219b64313dcbe1874dc1c8b0c)
 2017-03-25 14:33:20 -07:00
Junping Du
e796105a6f Add 2.8.0 RELEASENOTEs.md and CHANGES.md. 
(cherry picked from commit d8e6d6df4c23aa11455c1775391b1c7883bec2ea)
 2017-03-25 14:32:47 -07:00
Daniel Templeton
bbd08bb7a4 YARN-6360. Prevent FS state dump logger from cramming other log files 
(Contributed by Yufei Gu via Daniel Templeton)

(cherry picked from commit d49d1862a645b8c5d3eae95bf633bc82816f0168)
 2017-03-24 11:31:58 -07:00
Andrew Wang
96fe940e59 HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen. 
(cherry picked from commit 0e556a5ba645570d381beca60114a1239b27d49f)
 2017-03-24 11:12:31 -07:00
John Zhuge
d946dfcbe1 HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar. 
(cherry picked from commit 128015584d69492806fd1700c8f840d78aa9c729)
 2017-03-23 13:57:41 -07:00
Mingliang Liu
1e64c582f5 HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu 
(cherry picked from commit d35e79abc2fee7153a6168e6088f100de59d8c81)
 2017-03-23 13:34:53 -07:00
Ravi Prakash
87339d7691 HADOOP-14213. Move Configuration runtime check for hadoop-site.xml to initialization. Contributed by Jonathan Eagles 
(cherry picked from commit 595f62e362c08704d6fb692e21c97b512bc7ec49)
 2017-03-23 09:30:22 -07:00
Zhe Zhang
f98f4bb6ca HADOOP-9631. ViewFs should use underlying FileSystem's server side defaults. Contributed by Lohit Vijayarenu and Erik Krogen. 
(cherry picked from commit 59d69257a888347f0fb9c51bb000afc986b64f98)
 2017-03-22 22:32:07 -07:00
John Zhuge
84e2c11f96 HADOOP-14205. No FileSystem for scheme: adl. Contributed by John Zhuge. 2017-03-21 08:23:30 -07:00
John Zhuge
2c5de0c60e HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet Dusane 
(cherry picked from commit 19f373a46b2abb7a575f7884a9c7443b8ed67cd3)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/fs/FileSystemContractBaseTest.java
 2017-03-20 21:16:50 -07:00
Erik Krogen
e44569b736 HADOOP-14169. Implement listStatusIterator, listLocatedStatus for ViewFs. Contributed by Erik Krogen. 
(cherry picked from commit e1a99802fc5c2f2ad3ceb000378db1c0133069b3)
 2017-03-17 17:40:14 -07:00
Andrew Wang
7cc88eca43 HDFS-11516. Admin command line should print message to stderr in failure case. Contributed by Kai Sasaki. 
(cherry picked from commit 92ea6d74ecd84b86771e285902dd2a80bccbe3ea)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/cli/util/ErasureCodingCliCmdExecutor.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/resources/testErasureCodingConf.xml
 2017-03-17 11:34:43 -07:00
Jitendra Pandey
d564d1f44d HDFS-11533. reuseAddress option should be used for child channels in Portmap and SimpleTcpServer. Contributed by Mukul Kumar Singh. 2017-03-16 12:37:22 -07:00
Mingliang Liu
ed0d426a88 HADOOP-14170. FileSystemContractBaseTest is not cleaning up test directory clearly. Contributed by Mingliang Liu 2017-03-14 15:00:59 -07:00
Ray Chiang
fa59f4e490 YARN-6042. Dump scheduler and queue state information into FairScheduler DEBUG log. (Yufei Gu via rchiang) 2017-03-14 14:45:13 -07:00
Jing Zhao
e03d8ff488 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. 
(cherry picked from commit 55796a0946f80a35055701a34379e374399009c5)
 2017-03-13 14:26:44 -07:00
Jian He
8c44a9db21 HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-10 09:26:19 -08:00
Mingliang Liu
9ea6b24c49 HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran 
(cherry picked from commit fd26783aaf3deea7a4e197439bd1075a6689681f)
 2017-03-10 00:21:58 -08:00
Lei Xu
01624f0c1b HADOOP-13956. Read ADLS credentials from Credential Provider. (John Zhuge via lei) 
(cherry picked from commit e015b563197a475e354bf84fd27e7bbcc67e00a4)
 2017-03-09 15:16:28 -08:00
Arpit Agarwal
5cdcda34a2 HDFS-11477. Simplify file IO profiling configuration. Contributed by Hanisha Koneru. 2017-03-09 14:34:10 -08:00
Jian He
ea8d53de6a Revert "HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand" 
This reverts commit 36eda5af75a1c98b507ea497fce51aa936b2c699.
 2017-03-08 13:20:45 -08:00
John Zhuge
f1fd20be82 Revert "HADOOP-13606 swift FS to add a service load metadata file. Contributed by Steve Loughran" 
This reverts commit 53a12fa721bb431f7d481aac7d245c93efb56153.

(cherry picked from commit 98142d2f722e82d57b0e2bae6276f7c17fd99598)

Change-Id: Ia5fa901fa97391cd46d41f59cd05f7a19c7c7532
 2017-03-08 11:46:27 -08:00
Jian He
36eda5af75 HADOOP-14062. ApplicationMasterProtocolPBClientImpl.allocate fails with EOFException when RPC privacy is enabled. Contributed by Steven Rand 2017-03-08 10:49:07 -08:00
Arpit Agarwal
8be80ccb72 HDFS-11508. Fix bind failure in SimpleTCPServer & Portmap where bind fails because socket is in TIME_WAIT state. Contributed by Mukul Kumar Singh. 2017-03-07 11:41:12 -08:00
Mingliang Liu
ff050866bf HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth 
(cherry picked from commit 686823529be09bea2a6cecb3503ef722017475bc)
 2017-03-06 17:35:06 -08:00
Mingliang Liu
8323e651a1 Revert "HADOOP-13930. Azure: Add Authorization support to WASB. Contributed by Sivaguru Sankaridurg and Dushyanth" 
This reverts commit b26870c58ec6f88c6a3722c5fc856bbbd60c5550.
 2017-03-06 17:18:36 -08:00
Ray Chiang
d943480147 YARN-5665. Enhance documentation for yarn.resourcemanager.scheduler.class property. (Yufei Gu via rchiang) 
(cherry picked from commit d9dc444dc73fbe23f9e553d63baf83f12c636fa7)
 2017-03-06 14:05:09 -08:00
Andrew Wang
cf5a1390aa HDFS-11441. Add escaping to error message in KMS web UI. Contributed by Aaron T. Myers. 
(cherry picked from commit ec839b94c0eb3f09e74f8a3b0bc9a08b3f5418b2)
 2017-03-06 10:47:28 -08:00
Akira Ajisaka
ed55bcee1f
HADOOP-14108. CLI MiniCluster: add an option to specify NameNode HTTP port. Contributed by Takanobu Asanuma. 
(cherry picked from commit 209ecd1a5c056e096a5d804759f88302608d503b)
 2017-03-07 01:36:10 +09:00