Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
11,825 Commits 326 Branches 371 Tags
Commit Graph

3106 Commits

Author SHA1 Message Date
Arpit Agarwal
4f74b5e793 HADOOP-13466. Add an AutoCloseableLock class. (Chen Liang) 2016-08-04 12:32:23 -07:00
Arpit Agarwal
365a27099c HADOOP-13467. Shell#getSignalKillCommand should use the bash builtin on Linux. (Arpit Agarwal) 2016-08-04 10:08:23 -07:00
Kihwal Lee
c7fe1f5ec5 HADOOP-13442. Optimize UGI group lookups. Contributed by Daryn Sharp. 
(cherry picked from commit 94225152399e6e89fa7b4cff6d17d33e544329a3)
 2016-08-04 10:48:17 -05:00
Xiao Chen
bb10750067 HADOOP-13443. KMS should check the type of underlying keyprovider of KeyProviderExtension before falling back to default. Contributed by Anthony Young-Garner. 
(cherry picked from commit 05db64913d8c620cf481f74219bac9b72cb142af)
 2016-08-04 16:08:25 +08:00
Wei-Chiu Chuang
5964d65a4d HADOOP-13458. LoadBalancingKMSClientProvider#doOp should log IOException stacktrace. Contributed by Chen Liang. 
(cherry picked from commit a1f6564d31c16582ea949e4448091f1cc56c7dfe)
 2016-08-03 14:27:33 -07:00
Jason Lowe
5a34fa670e HADOOP-10980. TestActiveStandbyElector fails occasionally in trunk. Contributed by Eric Badger 
(cherry picked from commit c82745432a962c817a8a7db92bb830fb6af01e33)
 2016-08-03 20:19:52 +00:00
Kihwal Lee
9d62caa440 HADOOP-13483. Optimize IPC server protobuf decoding. Contributed by Daryn Sharp. 
(cherry picked from commit 580a8334963709e728ed677c815fb7fef9bca70e)

Conflicts:
	hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ipc/ProtobufRpcEngine.java
 2016-08-03 14:12:13 -05:00
Kihwal Lee
dd21d242eb HADOOP-13426. More efficiently build IPC responses. Contributed by Daryn Sharp. 
(cherry picked from commit 2d8227605fe22c1c05f31729edc8939013763c05)
 2016-08-03 09:33:04 -05:00
Arpit Agarwal
9850cf07fa HDFS-9353. Code and comment mismatch in JavaKeyStoreProvider. (Andras Bokor) 2016-08-02 15:18:01 -07:00
Arpit Agarwal
158dd2d5a2 HADOOP-13434. Add bash quoting to Shell class. (Owen O'Malley) 2016-08-02 13:40:56 -07:00
Chris Nauroth
ec522a1907 HADOOP-13081. add the ability to create multiple UGIs/subjects from one kerberos login. Contributed by Sergey Shelukhin. 
(cherry picked from commit 0458a2af6e925d023882714e8b7b0568eca7a775)
 2016-08-02 12:43:51 -07:00
Kihwal Lee
41882bd5ff HADOOP-13429. Dispose of unnecessary SASL servers. Contributed by Daryn Sharp. 
(cherry picked from commit b3018e73ccae43484d9cb85eabae814eb7f050a6)
 2016-08-02 10:52:10 -05:00
Akira Ajisaka
5469e128d3 HADOOP-13444. Replace org.apache.commons.io.Charsets with java.nio.charset.StandardCharsets. Contributed by Vincent Poon. 2016-08-02 10:17:33 +09:00
Xiao Chen
8fe4b2429a HADOOP-13381. KMS clients should use KMS Delegation Tokens from current UGI. Contributed by Xiao Chen. 
(cherry picked from commit 8ebf2e95d2053cb94c6ff87ca018811fe8276f2b)

Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2016-07-28 18:39:59 -07:00
Xiao Chen
24d464a150 HDFS-9276. Failed to Update HDFS Delegation Token for long running application in HA mode. Contributed by Liangliang Gu and John Zhuge 
(cherry picked from commit d9aae22fdf2ab22ae8ce4a9d32ac71b3dde084d3)
 2016-07-28 16:41:31 -07:00
Chris Nauroth
df2ed6b2c4 HADOOP-13422. ZKDelegationTokenSecretManager JaasConfig does not work well with other ZK users in process. Contributed by Sergey Shelukhin. 
(cherry picked from commit 255ea45e50e102505ee61eb0ba45ea93035abe3c)
 2016-07-26 15:33:30 -07:00
Chris Nauroth
e6ba69b4db HADOOP-13207. Specify FileSystem listStatus, listFiles and RemoteIterator. Contributed by Steve Loughran. 
(cherry picked from commit 5fda66e4a38c7597bc0bc9c94748c8491b7f3750)
 2016-07-22 15:38:34 -07:00
Chris Nauroth
382bcf21e7 HADOOP-13240. TestAclCommands.testSetfaclValidations fail. Contributed by John Zhuge. 
(cherry picked from commit 43cf6b101dacd96bacfd199826b717f6946109af)
 2016-07-21 14:12:39 -07:00
Jakob Homan
43a40fa009 HADOOP-12009. Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. backport to 2.8 2016-07-21 21:50:38 +01:00
Steve Loughran
5490ed5f87 HADOOP-13212 Provide an option to set the socket buffers in S3AFileSystem (Rajesh Balamohan) 2016-07-20 13:42:33 +01:00
Akira Ajisaka
8fe2c450b3 HADOOP-12991. Conflicting default ports in DelegateToFileSystem. Contributed by Kai Sasaki. 
(cherry picked from commit dc065dd64ca3e101b0c0a7bcc7d7a067b77d6c82)
 2016-07-19 16:06:16 -07:00
Allen Wittenauer
84c785036f HDFS-9852. hdfs dfs -setfacl error message is misleading (Wei-Chiu Chuang via aw) 
(cherry picked from commit b3649adf6a1b2dc47566b4b0d652bd4e0a6a8056)
 2016-07-19 14:40:51 -07:00
Akira Ajisaka
09375baad1 HADOOP-13202. Avoid possible overflow in org.apache.hadoop.util.bloom.BloomFilter#getNBytes. Contributed by Kai Sasaki. 
(cherry picked from commit c2bcffb34ebe4399b523a44f69d23761648bd0c4)
 2016-07-18 11:50:27 -07:00
Robert Kanter
04c8294b6f HADOOP-13254. Create framework for configurable disk checkers (yufeigu via rkanter) 
(cherry picked from commit 442162048a1509aece5dc92e70e874674f648d58)
 2016-07-15 13:41:41 -07:00
Akira Ajisaka
2231ef22f5 HADOOP-13289. Remove unused variables in TestFairCallQueue. Contributed by Ye Zhou. 
(cherry picked from commit 13814832331ad691b898cd9f602b0a0a771d7928)
 2016-07-14 23:15:34 -07:00
Zhe Zhang
b95f1af8a9 HADOOP-13290. Appropriate use of generics in FairCallQueue. Contributed by Jonathan Hung. 
(cherry picked from commit 728bf7f6988e13f17f03d2e3a4037b7238c4fd45)
 2016-07-13 16:38:09 -07:00
Akira Ajisaka
ee1e45e4b2 HADOOP-13366. Fix dead link in o.a.h.fs.CommonConfigurationKeysPublic javadoc. Contributed by Rakesh R. 
(cherry picked from commit 505ce884378f651991d04dda8c126f416bd69f56)
 2016-07-13 13:08:06 -07:00
Tsuyoshi Ozawa
22e719b16e HADOOP-11361. Fix a race condition in MetricsSourceAdapter.updateJmxCache. Contributed by Vinayakumar B, Yongjun Zhang, and Brahma Reddy Battula. (ozawa) 
(cherry picked from commit 77ffe7621212be9f462ca37a542a13d167eca4e0)
 2016-07-13 21:28:20 +09:00
Lei Xu
82c3c66dcb HADOOP-13315. FileContext#umask is not initialized properly. (John Zhuge via lei) 
(cherry picked from commit a290a98b6ab2424ae9b7faab0ce9496d09ca46f3)
 2016-07-12 16:50:12 -07:00
Steve Loughran
89121745c0 HADOOP-13139 Branch-2: S3a to use thread pool that blocks clients. Contributed by Pieter Reuse. 2016-07-11 17:21:00 +01:00
Akira Ajisaka
f4b63a391b Revert "HADOOP-10465. Fix use of generics within SortedMapWritable. Contributed by Bertrand Dechoux." 
This reverts commit 1d175f0f3f80a066a6de71213392d288329d837f.
 2016-07-09 21:00:13 -07:00
Jitendra Pandey
e4023f8b13 HADOOP-13352. Make X-FRAME-OPTIONS configurable in HttpServer2. Contributed by Anu Engineer. 2016-07-08 14:20:00 -07:00
Jitendra Pandey
63b64a20c2 HADOOP-13283. Support reset operation for new global storage statistics and per FS storage stats. Contributed by Mingliang Liu. 2016-07-07 15:00:34 -07:00
Akira Ajisaka
f78be97469 MAPREDUCE-6717. Remove deprecated StringUtils.getFormattedTimeWithDiff. Contributed by Shen Yinjie. 
(cherry picked from commit d1626a7b37472f8b76bfbd5ee484cefa7cba7d3d)
 2016-07-07 11:19:33 -07:00
Jian He
46f8204992 YARN-5296. NMs going OutOfMemory because ContainerMetrics leak in ContainerMonitorImpl. Contributed by Junping Du 
(cherry picked from commit d792a90206e940c31d1048e53dc24ded605788bf)
 2016-07-05 18:06:03 -07:00
Jitendra Pandey
06b89f0d14 HADOOP-13305. Define common statistics names across schemes. Contributed by Mingliang Liu. 2016-07-01 15:35:50 -07:00
Vinayakumar B
1458e66593 HADOOP-13314. Remove 'package-info.java' from 'test\java\org\apache\hadoop\fs\shell\' to remove eclipse compile error (Contributed by Vinayakumar B) 
(cherry picked from commit c25021fb7196f498ccf1319dbd0c7f948f8518c1)
 2016-07-01 12:21:47 +05:30
Andrew Wang
af581c0e23 HADOOP-12345. Pad hostname correctly in CredentialsSys.java. Contributed by Pradeep Nayak Udupi Kadbet. 
(cherry picked from commit 846ada2de33f9840d6e60fd7339ecc2d71f277c7)
 2016-06-29 17:32:49 -07:00
Masatake Iwasaki
b7b5807d2c HADOOP-12242. Add in-page TOC to filesystem specification pages. (iwasakims) 
(cherry picked from commit 5c07c573db06481c89f1c9ad062e2d2aa19feaa0)
 2016-06-30 07:23:30 +09:00
Steve Loughran
a82ea9275e HADOOP-12229 Fix inconsistent subsection titles in filesystem.md. Contributed by Masatake Iwasaki 2016-06-29 14:31:27 +01:00
Andrew Wang
22eb53eb71 HADOOP-13316. Enforce Kerberos authentication for required ops in DelegationTokenAuthenticator. Contributed by Xiao Chen. 
(cherry picked from commit 7d2070493e07198896bc49135bc84ef00499a375)
 2016-06-27 18:46:50 -07:00
Andrew Wang
d8a69c8737 HADOOP-13251. Authenticate with Kerberos credentials when renewing KMS delegation token. Contributed by Xiao Chen. 
(cherry picked from commit 771f798edf97b27ae003395118c0317b484df6ee)

 Conflicts:
	hadoop-common-project/hadoop-kms/src/test/java/org/apache/hadoop/crypto/key/kms/server/TestKMS.java
 2016-06-27 18:29:39 -07:00
Arpit Agarwal
f73e748754 HADOOP-13263. Reload cached groups in background after expiry. (Contributed bt Stephen O'Donnell) 2016-06-27 09:49:04 -07:00
Tsz-Wo Nicholas Sze
20ee619e32 HADOOP-13227. AsyncCallHandler should use an event driven architecture to handle async calls. 2016-06-25 15:46:33 +08:00
Sangjin Lee
ae90d4dd90 HDFS-7959. WebHdfs logging is missing on Datanode (Kihwal Lee via sjlee) 2016-06-24 14:48:36 -07:00
Colin Patrick Mccabe
e751bb4497 Fix accidental revert of HADOOP-13072: WindowsGetSpaceUsed constructor should be public (Vinayakumar B via cmccabe) 
(cherry picked from commit 975786492c42b8aebc6dc247bdcdb4768d99d641)
 2016-06-24 09:47:25 -07:00
Andrew Wang
8a1ee4d2b5 Revert "HADOOP-13228. Add delegation token to the connection in DelegationTokenAuthenticator. Contributed by Xiao Chen." 
This reverts commit 55eda958ccbf3941986d6da63ad7ee16646d7067.
 2016-06-23 11:08:52 -07:00
Allen Wittenauer
2a956baaab HADOOP-13245. Fix up some misc create-release issues (aw) 
(cherry picked from commit e2f640942b722e35490cf146c0268517da5a28b1)
 2016-06-23 15:15:23 +09:00
Masatake Iwasaki
81497a4451 HADOOP-12588. addendum patch to fix intermittent failure of TestGangliaMetrics. (iwasakims) 
(cherry picked from commit 67089875f0ea2a47cca0c237fccf239bf6fe2d53)
 2016-06-22 23:48:06 +09:00
Steve Loughran
fb9167fdef HADOOP-13203 S3A: Support fadvise "random" mode for high performance readPositioned() reads. Contributed by Rajesh Balamohan and stevel. 2016-06-22 15:42:30 +01:00