Commit Graph

4572 Commits

Author SHA1 Message Date
Jason Lowe 6e253c0391 HADOOP-15085. Output streams closed with IOUtils suppressing write errors. Contributed by Jim Brennan
(cherry picked from commit f8af0e2feb)
2017-12-14 10:19:07 -06:00
Yiqun Lin 925f3e62db HDFS-12883. RBF: Document Router and State Store metrics. Contributed by Yiqun Lin.
(cherry picked from commit 91c96bdf8e)
2017-12-14 16:02:37 +08:00
Andrew Wang 58225e4030 Update CHANGES, RELEASENOTES, jdiff for 3.0.0 release.
(cherry picked from commit d447152d49)
2017-12-13 13:05:45 -08:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) ba874d6787 HADOOP-15059. Undoing the switch of Credentials to PB format as default - done via HADOOP-12563 for supporting 2.x to 3.x upgrades.
(cherry picked from commit f19638333b)
2017-12-08 08:03:23 -08:00
John Zhuge fc9e156484 HADOOP-14872. CryptoInputStream should implement unbuffer. Contributed by John Zhuge.
(cherry picked from commit 6c32ddad30)
2017-12-07 21:08:16 -08:00
Xiao Chen 1d1401ad38 HADOOP-15056. Fix TestUnbuffer#testUnbufferException failure. Contributed by Jack Bearden.
(cherry picked from commit 19e0894209)
2017-12-07 21:06:25 -08:00
John Zhuge 9942952dd8 HADOOP-15012. Add readahead, dropbehind, and unbuffer to StreamCapabilities. Contributed by John Zhuge.
(cherry picked from commit bf6a660232)
2017-12-07 21:06:25 -08:00
Sean Mackrory 63d81cbbe7 HADOOP-15098. TestClusterTopology#testChooseRandom fails intermittently. Contributed by Zsolt Venczel.
(cherry picked from commit acb92904d0)
2017-12-07 13:24:12 -07:00
Lei Xu f3143d225a HDFS-12840. Creating a file with non-default EC policy in a EC zone is not correctly serialized in the editlog. Contributed by Lei (Eddy) Xu.
(cherry picked from commit 67662e2ac9)
2017-12-07 11:20:19 -08:00
Xiao Chen 55fa509eb6 HDFS-12396. Webhdfs file system should get delegation token from kms provider. Contributed by Rushabh S Shah.
(cherry picked from commit 404eab4dc0)
2017-12-04 10:49:58 -08:00
Chris Douglas 2399c96ee7 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak
(cherry picked from commit 42307e3c3a)
2017-12-02 23:32:44 -08:00
Chris Douglas 6266c52680 Revert "HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak"
This reverts commit 482fd5a880.
2017-12-01 11:19:17 -08:00
Chris Douglas 482fd5a880 HDFS-11576. Block recovery will fail indefinitely if recovery time > heartbeat interval. Contributed by Lukas Majercak
(cherry picked from commit 5304698dc8)
2017-12-01 10:30:08 -08:00
Robert Kanter 2c2ff7da05 HADOOP-13493. Compatibility Docs should clarify the policy for what takes precedence when a conflict is found (templedf via rkanter)
(cherry picked from commit 75a3ab88f5)
2017-11-30 07:39:51 -08:00
Xiao Chen 4f71c27f2e HADOOP-15067. GC time percentage reported in JvmMetrics should be a gauge, not counter. Contributed by Misha Dmitriev.
(cherry picked from commit d162252d7a)
2017-11-23 09:02:07 -08:00
Xiao Chen a78dbd1571 HADOOP-15023. ValueQueue should also validate (int) (lowWatermark * numValues) > 0 on construction.
(cherry picked from commit b1941b200d)
2017-11-15 16:44:48 -08:00
Daniel Templeton 4a70e75386 HADOOP-14876. Create downstream developer docs from the compatibility guidelines
(cherry picked from commit bfd588789a879b8583ea4abd59f4f5843c5ac285)
2017-11-14 13:20:27 -08:00
Andrew Wang 1c8d334287 Preparing for 3.0.1 development 2017-11-14 11:17:18 -08:00
Arun Suresh f6de2b741e Addendum patch for Configuration fix. (Jason Lowe via asuresh)
(cherry picked from commit b07e68b02a)
2017-11-13 14:05:41 -08:00
Xiaoyu Yao f90f772384 HADOOP-14987. Improve KMSClientProvider log around delegation token checking. Contributed by Xiaoyu Yao and Xiao Chen.
(cherry picked from commit 59d78a5088)
2017-11-12 19:44:18 -08:00
Anu Engineer ba4355a62f HADOOP-14901. ReuseObjectMapper in Hadoop Common. Contributed by Hanisha Koneru.
(cherry picked from commit e1b32e0959)
2017-11-12 19:44:18 -08:00
Chris Douglas 7f80c2f293 HADOOP-8522. ResetableGzipOutputStream creates invalid gzip files when finish() and resetState() are used. Contributed by Mike Percy
(cherry picked from commit 796a0d3a5c)
2017-11-10 17:45:15 -08:00
Xiao Chen 65d7968afd HADOOP-14960. Add GC time percentage monitor/alerter. Contributed by Misha Dmitriev.
(cherry picked from commit 3c6adda291)
2017-11-09 21:06:43 -08:00
Arun Suresh 72d7bedac9 Fixing Job History Server Configuration parsing. (Jason Lowe via asuresh)
(cherry picked from commit 5eb7dbe9b3)
2017-11-09 15:16:55 -08:00
Chris Douglas b5f66b005c Revert "HDFS-7878. API - expose a unique file identifier."
This reverts commit 1ce0eb7d23.
2017-10-31 13:56:41 -07:00
Wei-Chiu Chuang cba1fa496b HADOOP-14880. [KMS] Document&test missing KMS client side configs. Contributed by Gabor Bota.
(cherry picked from commit 97c70c7ac6)
2017-10-31 12:54:53 -07:00
Chen Liang af52a585f0 HADOOP-14915. method name is incorrect in ConfServlet. Contributed by Bharat Viswanadham.
(cherry picked from commit 563dcdfc1d)
2017-10-31 12:54:28 -07:00
Wei-Chiu Chuang 0b3e3e4895 HADOOP-14948. Document missing config key hadoop.treat.subject.external. Contributed by Ajay Kumar.
(cherry picked from commit e906108fc9)
2017-10-31 12:54:03 -07:00
Chris Douglas 1ce0eb7d23 HDFS-7878. API - expose a unique file identifier.
(cherry picked from commit d015e0bbd5)
2017-10-31 09:46:39 -07:00
Jason Lowe 75605766fd HADOOP-14919. BZip2 drops records when reading data in splits. Contributed by Jason Lowe
(cherry picked from commit 2fae63aa60)
2017-10-31 09:32:02 -05:00
Junping Du ce10c1ef05 Add several jdiff xml files for 2.8.2 release.
(cherry picked from commit a25b5aa0cf)
2017-10-26 23:18:50 -07:00
Junping Du f36b2c6990 Update CHANGES.md and RELEASENOTES for 2.8.2 release.
(cherry picked from commit 1ad863e220)
2017-10-26 23:18:23 -07:00
Xiao Chen e18d2c548b HADOOP-14957. ReconfigurationTaskStatus is exposing guava Optional in its public api. Contributed by Haibo Chen, Xiao Chen.
(cherry picked from commit e3f25f361720b544b464c5e4fbeb4f31e6c53c67)
2017-10-25 14:11:38 -07:00
Akira Ajisaka 79ea3e8ea7
HADOOP-14030. PreCommit TestKDiag failure. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 4c970088af)
2017-10-25 17:18:49 +09:00
Varun Saxena 5be228e43b HADOOP-9657. NetUtils.wrapException to have special handling for 0.0.0.0 addresses and :0 ports. Contributed by Varun Saxena.
(cherry picked from commit 67e7673750)
2017-10-25 03:22:18 +05:30
Naganarasimha faf23e6298 HADOOP-14966. Handle JDK-8071638 for hadoop-common. Contributed by Bibin A Chundatt.
(cherry picked from commit 6b8122458e)
2017-10-23 23:43:57 +05:30
Kai Zheng b7cb58a21d HDFS-12448. Make sure user defined erasure coding policy ID will not overflow. Contributed by Huafeng Wang 2017-10-20 09:34:58 +08:00
Junping Du 9433f9eb09 HADOOP-14958. Fix source-level compatibility after HADOOP-11252. Contributed by Junping Du.
(cherry picked from commit b016f08f67)
2017-10-18 15:07:20 -07:00
Anu Engineer 0160a708ae HADOOP-14752. TestCopyFromLocal#testCopyFromLocalWithThreads is fleaky. Contributed by Andras Bokor.
(cherry picked from commit 442ea85545)
2017-10-18 11:26:23 -07:00
Xiao Chen 12d19d3978 HADOOP-14944. Add JvmMetrics to KMS.
(cherry picked from commit 86ee0c5e4e)
2017-10-17 19:07:19 -07:00
Lei Xu cdfcd384b2 HDFS-12613. Native EC coder should implement release() as idempotent function. (Lei (Eddy) Xu)
(cherry picked from commit 31ebccc962)
2017-10-16 19:46:26 -07:00
Robert Kanter a9cbfb0398 HADOOP-14938. Configuration.updatingResource map should be initialized lazily (misha@cloudera.com via rkanter) 2017-10-16 16:39:25 -07:00
Xiao Chen 23ec4a788a HADOOP-14949. TestKMS#testACLs fails intermittently.
(cherry picked from commit 152317d40ece8abfa76fb5bd29f04878c1b0d3d8)
2017-10-16 14:19:44 -07:00
Anu Engineer beb54e5279 HADOOP-13102. Update GroupsMapping documentation to reflect the new changes. Contributed by Esther Kundin.
(cherry picked from commit 075358eb6f)
2017-10-11 16:24:08 -07:00
Arun Suresh 52844ec0a1 HADOOP-13556. Change Configuration.getPropsWithPrefix to use getProps instead of iterator. (Larry McCay via asuresh)
(cherry picked from commit b6c2c9058e)
2017-10-11 15:22:18 -07:00
Jason Lowe c0d56cad5c HADOOP-14912. FairCallQueue may defer servicing calls. Contributed by Daryn Sharp
(cherry picked from commit 1123f8f0b6)
2017-10-10 14:49:15 -05:00
Xiao Chen 3106552b75 HADOOP-14521. KMS client needs retry logic. Contributed by Rushabh S Shah.
(cherry picked from commit 212342d6db14673f8f5652a5209e1c4fcc0f0ede)
2017-10-05 19:47:13 -07:00
Akira Ajisaka 5c2f07eed7
HADOOP-14616. Client fails to read a block with erasure code (XOR, native) when one of the data block is lost. Contributed by Huafeng Wang.
(cherry picked from commit fe84cdc9da)
2017-10-05 11:07:33 +09:00
Daniel Templeton 280b1fe1b4 HADOOP-14459. SerializationFactory shouldn't throw a NullPointerException if the serializations list is not defined
(Contributed by Nandor Kollar via Daniel Templeton)

(cherry picked from commit 20e9ce3ab3)
2017-10-04 15:11:03 +02:00
Akira Ajisaka b658ae002f
YARN-6943. Update Yarn to YARN in documentation. Contributed by Chetna Chaudhari.
(cherry picked from commit c9b525bd94)
2017-10-04 07:02:31 +09:00