Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,272 Commits 326 Branches 371 Tags
Commit Graph

4585 Commits

Author SHA1 Message Date
Xiao Chen
75be15cf02 HDFS-12974. Exception message is not printed when creating an encryption zone fails with AuthorizationException. Contributed by fang zhenyi. 
(cherry picked from commit b63dcd583f0b98e785831004f41bd7c7de8b3c18)
 2018-01-28 22:24:00 -08:00
Steve Loughran
ec4f5f0f0d HADOOP-15039/HADOOP-15189. Move SemaphoredDelegatingExecutor to hadoop-common 
Contributed by Genmao Yu
 2018-01-26 15:23:08 -08:00
Chris Douglas
7f35487788 MapFile.fix creates a wrong index file in case of block-compressed data file. Contributed by Grigori Rybkine 
(cherry picked from commit 91db424c4360d7556660e8c57ac9a266e6688e01)
 2018-01-26 09:15:03 -08:00
Wei Yan
c5c042135d HDFS-13049. RBF: Inconsistent Router OPTS config in branch-2 and branch-3. Contributed by Wei Yan. 
(cherry picked from commit 0c139d5bcfbcd62fc69111ee6204926c57d57bf1)
 2018-01-25 12:52:45 -08:00
Hanisha Koneru
304642322f HADOOP-15121. Encounter NullPointerException when using DecayRpcScheduler. Contributed by Tao Jie. 
(cherry picked from commit 3fde0f1db599227773c0cd537b33312d368ad4d9)
 2018-01-22 16:26:23 -08:00
Masahiro Tanaka
dcb09c30b9
HADOOP-15181. Typo in SecureMode.md 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 6e27b20b4d695ed94bd44c60f191cfbb5cdb32e2)
 2018-01-22 17:15:14 +09:00
Jitendra Pandey
169dacf1ee HADOOP-15143. NPE due to Invalid KerberosTicket in UGI. Contributed by Mukul Kumar Singh. 
(cherry picked from commit d31c9d8c495794a803fb20729b5ed6b374e23eb4)
 2018-01-18 20:02:48 -08:00
Brahma Reddy Battula
e575406715 HADOOP-15150. in FsShell, UGI params should be overidden through env vars(-D arg). Contributed by Brahma Reddy Battula. 
(cherry picked from commit 08332e12d055d85472f0c9371fefe9b56bfea1ed)
 2018-01-18 10:56:12 +05:30
Miklos Szegedi
542cb8480c HADOOP-15060. TestShellBasedUnixGroupsMapping.testFiniteGroupResolutionTime flaky. Contributed by Miklos Szegedi. 
(cherry picked from commit 12d0645)
 2018-01-10 11:04:40 -08:00
Haibo Chen
889bebf8bb YARN-7602. NM should reference the singleton JvmMetrics instance. 
(cherry picked from commit 2f6c038be6c23522ea64fc4e415910fb72493eb2)
 2018-01-03 09:44:33 -08:00
Xiao Chen
8c275c63ff HADOOP-15149. CryptoOutputStream should implement StreamCapabilities. 
(cherry picked from commit 81127616c571b7cd25686e60a1105f96ca0626b7)
 2017-12-29 13:41:43 -08:00
Junping Du
53b9d81f46 Add 2.8.3 release jdiff files. 
(cherry picked from commit c89f99aade575ab1f6a9836df719cda272293d90)
 2017-12-18 22:40:04 -08:00
Steve Loughran
f61edab1d0 HADOOP-15123. KDiag tries to load krb5.conf from KRB5CCNAME instead of KRB5_CONFIG. 
Contributed by Vipin Rathor.

(cherry picked from commit 1ef906e29e0989aafcb35c51ad2acbb262b3c8e7)
 2017-12-18 18:49:41 +00:00
Jason Lowe
6e253c0391 HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan 
(cherry picked from commit f8af0e2feb9f45aeaa9711dbf93115ffb1a07e5d)
 2017-12-14 10:19:07 -06:00
Yiqun Lin
925f3e62db HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin. 
(cherry picked from commit 91c96bdf8eb9a06193b719186b527563091d7666)
 2017-12-14 16:02:37 +08:00
Andrew Wang
58225e4030 Update CHANGES, RELEASENOTES, jdiff for 3.0.0 release. 
(cherry picked from commit d447152d4925a5f84d28a8ebd561286b39134d75)
 2017-12-13 13:05:45 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
ba874d6787 HADOOP-15059. Undoing the switch of Credentials to PB format as default - done via HADOOP-12563 for supporting 2.x to 3.x upgrades. 
(cherry picked from commit f19638333b11da6dcab9a964e73a49947b8390fd)
 2017-12-08 08:03:23 -08:00
John Zhuge
fc9e156484 HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge. 
(cherry picked from commit 6c32ddad30240a251caaefdf7fec9ff8ad177a7c)
 2017-12-07 21:08:16 -08:00
Xiao Chen
1d1401ad38 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden. 
(cherry picked from commit 19e089420999dd9d97d981dcd0abd64b6166152d)
 2017-12-07 21:06:25 -08:00
John Zhuge
9942952dd8 HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge. 
(cherry picked from commit bf6a660232b01642b07697a289c773ea5b97217c)
 2017-12-07 21:06:25 -08:00
Sean Mackrory
63d81cbbe7 HADOOP-15098. TestClusterTopology#testChooseRandom fails intermittently. Contributed by Zsolt Venczel. 
(cherry picked from commit acb92904d04053551d3010937e133f74450043df)
 2017-12-07 13:24:12 -07:00
Lei Xu
f3143d225a HDFS-12840. Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog. Contributed by Lei (Eddy) Xu. 
(cherry picked from commit 67662e2ac9e68f32b725c8118cf2be79a662fca5)
 2017-12-07 11:20:19 -08:00
Xiao Chen
55fa509eb6 HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah. 
(cherry picked from commit 404eab4dc0582e0384b93664ea6ee77ccd5eeebc)
 2017-12-04 10:49:58 -08:00
Chris Douglas
2399c96ee7 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit 42307e3c3abbfe0b83d9a2581deba327435b910f)
 2017-12-02 23:32:44 -08:00
Chris Douglas
6266c52680 Revert "HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak" 
This reverts commit 482fd5a880994f37fc3ad9e0cc2d127737b70aef.
 2017-12-01 11:19:17 -08:00
Chris Douglas
482fd5a880 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak 
(cherry picked from commit 5304698dc8c5667c33e6ed9c4a827ef57172a723)
 2017-12-01 10:30:08 -08:00
Robert Kanter
2c2ff7da05 HADOOP-13493. Compatibility Docs should clarify the policy for what takes precedence when a conflict is found (templedf via rkanter) 
(cherry picked from commit 75a3ab88f5f4ea6abf0a56cb8058e17b5a5fe403)
 2017-11-30 07:39:51 -08:00
Xiao Chen
4f71c27f2e HADOOP-15067. GC time percentage reported in JvmMetrics should be a gauge, not counter. Contributed by Misha Dmitriev. 
(cherry picked from commit d162252d7a7223631ff66ba0210953296407e55f)
 2017-11-23 09:02:07 -08:00
Xiao Chen
a78dbd1571 HADOOP-15023. ValueQueue should also validate (int) (lowWatermark * numValues) > 0 on construction. 
(cherry picked from commit b1941b200d6b4fa6a7891421c0a1e212cad3d6eb)
 2017-11-15 16:44:48 -08:00
Daniel Templeton
4a70e75386 HADOOP-14876. Create downstream developer docs from the compatibility guidelines 
(cherry picked from commit bfd588789a879b8583ea4abd59f4f5843c5ac285)
 2017-11-14 13:20:27 -08:00
Andrew Wang
1c8d334287 Preparing for 3.0.1 development 2017-11-14 11:17:18 -08:00
Arun Suresh
f6de2b741e Addendum patch for Configuration fix. (Jason Lowe via asuresh) 
(cherry picked from commit b07e68b02a34d272114dda4194992a847928aef8)
 2017-11-13 14:05:41 -08:00
Xiaoyu Yao
f90f772384 HADOOP-14987. Improve KMSClientProvider log around delegation token checking. Contributed by Xiaoyu Yao and Xiao Chen. 
(cherry picked from commit 59d78a5088700350a5122c3a3ba5e76cd26d6a80)
 2017-11-12 19:44:18 -08:00
Anu Engineer
ba4355a62f HADOOP-14901. ReuseObjectMapper in Hadoop Common. Contributed by Hanisha Koneru. 
(cherry picked from commit e1b32e0959dea5f5a40055157476f9320519a618)
 2017-11-12 19:44:18 -08:00
Chris Douglas
7f80c2f293 HADOOP-8522. ResetableGzipOutputStream creates invalid gzip files when finish() and resetState() are used. Contributed by Mike Percy 
(cherry picked from commit 796a0d3a5c661f0c3b23af9c0db2d8f3db83c322)
 2017-11-10 17:45:15 -08:00
Xiao Chen
65d7968afd HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev. 
(cherry picked from commit 3c6adda291745c592741b87cd613214ae11887e4)
 2017-11-09 21:06:43 -08:00
Arun Suresh
72d7bedac9 Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh) 
(cherry picked from commit 5eb7dbe9b31a45f57f2e1623aa1c9ce84a56c4d1)
 2017-11-09 15:16:55 -08:00
Chris Douglas
b5f66b005c Revert "HDFS-7878. API - expose a unique file identifier." 
This reverts commit 1ce0eb7d23156175db2d31f3fcbbe6529944c04b.
 2017-10-31 13:56:41 -07:00
Wei-Chiu Chuang
cba1fa496b HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota. 
(cherry picked from commit 97c70c7ac6881f87eee1575bcbdd28b31ecac231)
 2017-10-31 12:54:53 -07:00
Chen Liang
af52a585f0 HADOOP-14915. method name is incorrect in ConfServlet. Contributed by Bharat Viswanadham. 
(cherry picked from commit 563dcdfc1de7ea9ee7ce296163cf2678dfe5349c)
 2017-10-31 12:54:28 -07:00
Wei-Chiu Chuang
0b3e3e4895 HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar. 
(cherry picked from commit e906108fc98a011630d12a43e557b81d7ef7ea5d)
 2017-10-31 12:54:03 -07:00
Chris Douglas
1ce0eb7d23 HDFS-7878. API - expose a unique file identifier. 
(cherry picked from commit d015e0bbd5416943cb4875274e67b7077c00e54b)
 2017-10-31 09:46:39 -07:00
Jason Lowe
75605766fd HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe 
(cherry picked from commit 2fae63aa60c43b62bd908a9499562fe528603185)
 2017-10-31 09:32:02 -05:00
Junping Du
ce10c1ef05 Add several jdiff xml files for 2.8.2 release. 
(cherry picked from commit a25b5aa0cf5189247fa38e7b0a188d568eba1b6c)
 2017-10-26 23:18:50 -07:00
Junping Du
f36b2c6990 Update CHANGES.md and RELEASENOTES for 2.8.2 release. 
(cherry picked from commit 1ad863e22046c3c6a3e22a82cec52264b922888d)
 2017-10-26 23:18:23 -07:00
Xiao Chen
e18d2c548b HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen. 
(cherry picked from commit e3f25f361720b544b464c5e4fbeb4f31e6c53c67)
 2017-10-25 14:11:38 -07:00
Akira Ajisaka
79ea3e8ea7
HADOOP-14030. PreCommit TestKDiag failure. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 4c970088afefe5395c18c6715c7b27e6c0358c96)
 2017-10-25 17:18:49 +09:00
Varun Saxena
5be228e43b HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena. 
(cherry picked from commit 67e7673750e731f5ecfa84e82b84b7fc7ee0b233)
 2017-10-25 03:22:18 +05:30
Naganarasimha
faf23e6298 HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt. 
(cherry picked from commit 6b8122458ede9ececb138bed99d368580e5439a1)
 2017-10-23 23:43:57 +05:30
Kai Zheng
b7cb58a21d HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang 2017-10-20 09:34:58 +08:00