Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
12,233 Commits 326 Branches 371 Tags
Commit Graph

3171 Commits

Author SHA1 Message Date
Anu Engineer
182c3f8398 HADOOP-13737. Cleanup DiskChecker interface. Contributed by Arpit Agarwal. 
(cherry picked from commit 1f384b617d101f61ac61b5b030c9cbaf8fc9a9b1)
 2017-06-09 14:12:25 +05:30
John Zhuge
a86081408d HADOOP-14511. WritableRpcEngine.Invocation#toString NPE on null parameters. Contributed by John Zhuge. 
(cherry picked from commit 87f4428de017e5bfc4358304728bd2281d501d52)
 2017-06-08 21:31:00 -07:00
John Zhuge
01b6c6c3b2 HDFS-11861. ipc.Client.Connection#sendRpcRequest should log request name. Contributed by John Zhuge. 
(cherry picked from commit 5672ae7b37ce75086a1cb5bb9a388288fc913eb7)
 2017-06-07 15:54:45 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
396de0fd8f Preparing for 2.8.3 development 2017-06-07 15:38:20 -07:00
Kihwal Lee
a83d7ef605 HADOOP-14035. Reduce fair call queue backoff's impact on clients. Contributed by Daryn Sharp. 2017-06-06 13:09:54 -05:00
Kihwal Lee
9854682ea4 HADOOP-14440. Add metrics for connections dropped. Contributed by Eric Badger. 
(cherry picked from commit abdd609e51a80388493417126c3bc9b1badc0ac1)
 2017-06-05 11:34:40 -05:00
Kihwal Lee
89d59c292f HDFS-5042. Completed files lost after power failure. Contributed by Vinayakumar B. 2017-06-01 12:25:27 -05:00
Arpit Agarwal
76c15121d8 HDFS-11891. DU#refresh should print the path of the directory when an exception is caught. Contributed by Chen Liang. 2017-05-26 16:03:04 -07:00
Amar Kamat
425d597d48 HADOOP-7851. Configuration.getClasses() never returns the default value. (amarrk) 
(cherry picked from commit 82d57ee7fee82919b42066af38063a27d0998806)
 2017-05-24 17:06:26 -07:00
Brahma Reddy Battula
d9492839d0 HADOOP-14166. Reset the DecayRpcScheduler AvgResponseTime metric to zero when queue is not used. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit dcf4559ebdb5bb11d03b264a9875bff316b89eef)
 2017-05-25 01:28:36 +08:00
Brahma Reddy Battula
cf4e6d6b1d HADOOP-14449. The ASF Header in ComparableVersion.java and SSLHostnameVerifier.java is not correct. Contributed by ZhangBing Lin. 
(cherry picked from commit b7a0c0e7019528fac492e1cb32d374ed014f8673)
 2017-05-25 01:09:20 +08:00
Brahma Reddy Battula
462c6fb5b1 HDFS-11864. Document Metrics to track usage of memory for writes. Contributed by Yiqun Lin. 
(cherry picked from commit 52661e0912a79d1e851afc2b46c941ce952ca63f)
 2017-05-24 23:47:20 +08:00
Chris Douglas
475b50b44c HADOOP-14434. Use MoveFileEx to allow renaming a file when the destination exists. Contributed by Lukas Majercak 
(cherry picked from commit ef9e536a7137d209985d25a4769712c2db2c52bf)
(cherry picked from commit 4bb056544341726dd051353f1cc8430b801bf391)
 2017-05-17 17:25:08 -07:00
Rohith Sharma K S
c61956dd1e HADOOP-14412. HostsFileReader#getHostDetails is very expensive on large clusters. Contributed by Jason Lowe. 2017-05-17 08:26:17 +05:30
Jason Lowe
dfa2657abf HADOOP-14376. Memory leak when reading a compressed file using the native library. Contributed by Eli Acherkan 
(cherry picked from commit 7bc217224891b7f7f0a2e35e37e46b36d8c5309d)
 2017-05-12 16:59:21 -05:00
Akira Ajisaka
4f8dd60e49
HADOOP-14373. License error in org.apache.hadoop.metrics2.util.Servers. Contributed by hu xiaodong. 
(cherry picked from commit a5fa954684f517bdf0a50f3fa7a0314f24cc7049)
(cherry picked from commit d9c3c78b7809d48e965046b2f76ac01e70942937)
 2017-05-10 05:30:55 -05:00
Masatake Iwasaki
59702efb78 HADOOP-14405. Fix performance regression due to incorrect use of DataChecksum. Contributed by LiXin Ge. 
(cherry picked from commit 06ffeb8d4d705d14e8755364099286ac4ed3bb83)
 2017-05-10 14:45:23 +09:00
Jason Lowe
7489f0fd1a HADOOP-14377. Increase Common test timeouts from 1 second to 10 seconds. Contributed by Eric Badger 
(cherry picked from commit f9ba4ef7d5e50be86ffca71b6c4bbc5575f64326)

Conflicts:
	hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/service/TestCompositeService.java
 2017-05-09 16:23:31 -05:00
Xiaoyu Yao
a80ac0822b HADOOP-14207. "dfsadmin -refreshCallQueue" fails with DecayRpcScheduler. Contributed by Surendra Singh Lihore. 
(cherry picked from commit 918dee10f56861d15bb6644edcefb4246a3e00a4)
(cherry picked from commit 81883e3150c42e866ba9e68d68b734f2772344b2)
 2017-05-04 16:03:39 -07:00
Kihwal Lee
103dfae7b9 HADOOP-14372. TestSymlinkLocalFS timeouts are too low. Contributed by Eric Badger. 
(cherry picked from commit d4631e466bc85ce605061673a31f451353da9713)
 2017-05-03 09:49:50 -05:00
Jason Lowe
e4af087d92 HADOOP-14306. TestLocalFileSystem tests have very low timeouts. Contributed by Eric Badger 
(cherry picked from commit cedaf4cab9d5013acd559dcb92d4976823ccdf85)
 2017-05-02 16:54:00 -05:00
Andrew Wang
ab511286fd HADOOP-14369. NetworkTopology calls expensive toString() when logging. Contributed by Inigo Goiri. 
(cherry picked from commit dcc292d7ded200a4976f6d348952ecba10f01db2)
(cherry picked from commit 484bab39442939e1fe8424def25d1aa4ca99a2e5)
 2017-05-02 10:53:59 -07:00
Akira Ajisaka
42fa35d531
HADOOP-14371. License error in TestLoadBalancingKMSClientProvider.java. Contributed by hu xiaodong. 
(cherry picked from commit 20cde552748cc6be1c5ca590755d4e5a67baf187)
(cherry picked from commit 036624900be0bcc2af7f60a28a72cea0295f7300)
 2017-05-02 23:39:25 +09:00
Eric Payne
84106e80a8 HADOOP-14320. TestIPC.testIpcWithReaderQueuing fails intermittently. Contributed by Eric Badger. 
(cherry picked from commit 6fe11f61556407f8efb9b376623cd61609a40d5f)
 2017-04-28 14:55:14 -05:00
Steve Loughran
40b9c30d64
HADOOP-14346. CryptoOutputStream throws IOException if stream is closed. 
Contributed by Pierre Lacave
 2017-04-27 12:17:20 +01:00
John Zhuge
19e94bfd1b HADOOP-14341. Support multi-line value for ssl.server.exclude.cipher.list. Contributed by John Zhuge. 
(cherry picked from commit 9ccb849eb69f05bccc3435306ec4bde104e411bf)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/http/HttpServer2.java
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/ssl/SSLFactory.java
 2017-04-25 22:41:27 -07:00
John Zhuge
28f0de875d HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge. 
(cherry picked from commit 6865746ea444c57569e9b2464d8240dafcdbaaa5)
 2017-04-19 22:24:33 -07:00
John Zhuge
e813110734 Revert "HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge." 
This reverts commit 935ea448c1364befb58dd1ccedd4d7f736c8002a.
 2017-04-19 13:34:43 -07:00
John Zhuge
935ea448c1 HADOOP-14241. Add ADLS sensitive config keys to default list. Contributed by John Zhuge. 
(cherry picked from commit 0344bea3fd4031622edd828a610c9fdc23c53d26)
 2017-04-19 12:09:09 -07:00
Kengo Seki
525b258944
HADOOP-14315. Python example in the rack awareness document doesn't work due to bad indentation 
This closes #214

Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 654372db859656a2201ae9f9f7c374c6564ea34d)
(cherry picked from commit 6cfceee86547211c71f8cb6f9c63798a229de03e)
 2017-04-18 17:16:03 +09:00
Akira Ajisaka
c8bcc96500
HADOOP-14318. Remove non-existent setfattr command option from FileSystemShell.md. Contributed by Doris Gu. 
(cherry picked from commit 84a8848aaecd56b4cc85185924c2e33674165e01)
(cherry picked from commit a17bd7089263511b46918948843d05bb18750b1f)
 2017-04-18 16:46:01 +09:00
Chris Nauroth
c4bf504395 HDFS-11163. Mover should move the file blocks to default storage once policy is unset. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 00ed21a6fedb45a7c8992b8d45adaa83f14af34c)
(cherry picked from commit d5e2bd4096bf2b4d8a5a22042145a08905f93cd4)
 2017-04-11 21:55:28 -07:00
Steve Loughran
32475a7b6c HADOOP-14066 VersionInfo should be marked as public API 
(cherry picked from commit 2ed65540a3fe73db5d2dd0d25e658ccf13c9188a)
 2017-04-11 15:06:45 -07:00
Junping Du
dfac95a3a2 Preparing for 2.8.1 development 2017-04-11 11:21:49 -07:00
Andrew Wang
c8d494197f HADOOP-14293. Initialize FakeTimer with a less trivial value. 
(cherry picked from commit be144117a885cb39bc192279c96cbe3790dc77b1)
(cherry picked from commit dab1deb9a0c96471b6da4ef95be86cbc81d55305)
 2017-04-10 11:37:35 -07:00
John Zhuge
fa8e411d47 HADOOP-14174. Set default ADLS access token provider type to ClientCredential. Contributed by John Zhuge. 
Signed-off-by: John Zhuge <jzhuge@apache.org>
(cherry picked from commit 56e81f2a204d5e65d29222df1b2ba4d892f9c0d5)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
 2017-04-07 15:05:09 -07:00
Zhe Zhang
ef8b30dd4b HADOOP-14276. Add a nanosecond API to Time/Timer/FakeTimer. Contributed by Erik Krogen. 
(cherry picked from commit 95b7f1d29a5e2dadd70a56fca5faa006c5bd74fc)
(cherry picked from commit c85026038a6ef8d38b7a8563fbb64ac6edd1d4ce)
 2017-04-07 10:52:02 -07:00
Andrew Wang
b1dfdea5b4 HADOOP-14104. Client should always ask namenode for kms provider path. Contributed by Rushabh S Shah. 2017-04-06 14:39:56 -07:00
Wei-Chiu Chuang
eff4b2fa07 HDFS-10683. Make class Token$PrivateToken private. Contributed by John Zhuge. 
(cherry picked from commit c5ca2169151a5eec57152775789b6f53664e102c)
(cherry picked from commit 434403a2a0863e4d572e04e05e85d4f333bd6339)
 2017-04-05 16:35:49 -07:00
Xiao Chen
7ad5b278a7 HDFS-9276. Failed to Update HDFS Delegation Token for long running application in HA mode. Contributed by Liangliang Gu and John Zhuge 
(cherry picked from commit d9aae22fdf2ab22ae8ce4a9d32ac71b3dde084d3)
(cherry picked from commit 24d464a15015a7bf6d02d259568fedab1cb97b84)
 2017-04-05 16:35:44 -07:00
Jing Zhao
e216c15625 HDFS-11395. RequestHedgingProxyProvider#RequestHedgingInvocationHandler hides the Exception thrown from NameNode. Contributed by Nandakumar. 
(cherry picked from commit 55796a0946f80a35055701a34379e374399009c5)
(cherry picked from commit e03d8ff488c5818fbe167fa0143c252d7b6287f0)
 2017-04-05 16:29:04 -07:00
Mingliang Liu
ba3a726988 HADOOP-14247. FileContextMainOperationsBaseTest should clean up test root path. Contributed by Mingliang Liu 
(cherry picked from commit 13c766b62c48ae07849f7f1762ef6883239aef54)
 2017-03-29 11:23:46 -07:00
John Zhuge
c543c0549d HADOOP-14038. Rename ADLS credential properties. Contributed by John Zhuge. 
(cherry picked from commit 253e3e78abb9ebe0e8103d25538ff07875b33c84)
 2017-03-27 23:08:03 -07:00
Jonathan Eagles
ec5a65a0ca Configuration#get return value optimization (jeagles) 
(cherry picked from commit e41aac0cd41c6a4ee740afd09126bc48072880ab)
 2017-03-27 12:53:42 -05:00
Jonathan Eagles
4e40e9d4db Delay construction of PreCondition.check failure message in Configuration#set (jeagles) 
(cherry picked from commit 858d597be00ce006c1d1d4cd476729e4f1de8d25)
 2017-03-27 11:06:41 -05:00
Junping Du
7ec1e6e4f0 Add 2.8.0 RELEASENOTEs.md and CHANGES.md. 
(cherry picked from commit d8e6d6df4c23aa11455c1775391b1c7883bec2ea)
(cherry picked from commit e796105a6fe17a9307f3936cd59763cb173462f7)
 2017-03-25 14:35:43 -07:00
Junping Du
86800b30a9 Add COMMON/MAPREDUCE/YARN jdiff of 2.8.0 release. 
(cherry picked from commit 6df029db36412b7219b64313dcbe1874dc1c8b0c)
(cherry picked from commit 3ad4d3736391f4e443d7fef79770a1fda2a535c2)
 2017-03-25 14:34:55 -07:00
Andrew Wang
5130128a31 HADOOP-14211. FilterFs and ChRootedFs are too aggressive about enforcing 'authorityNeeded'. Contributed by Erik Krogen. 
(cherry picked from commit 0e556a5ba645570d381beca60114a1239b27d49f)
(cherry picked from commit 96fe940e59127dc7c3e4182c3ed450c3cd8d858e)
 2017-03-24 11:25:58 -07:00
John Zhuge
a92f654aa2 HADOOP-14195. CredentialProviderFactory$getProviders is not thread-safe. Contributed by Vihang Karajgaonkar. 
(cherry picked from commit 128015584d69492806fd1700c8f840d78aa9c729)
 2017-03-23 13:58:11 -07:00
Mingliang Liu
47d3c29e30 HADOOP-14214. DomainSocketWatcher::add()/delete() should not self interrupt while looping await(). Contributed by Mingliang Liu 
(cherry picked from commit d35e79abc2fee7153a6168e6088f100de59d8c81)
 2017-03-23 13:39:42 -07:00