Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,347 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

20347 Commits

Author SHA1 Message Date
Ted Yu a7dd244a49 HADOOP-15850. CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0. Contributed by Ted Yu. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit e2cecb681e)
 2018-10-19 13:22:01 -07:00
Eric Yang 04600cf5da YARN-8910. Fixed misleading log statement when container max retries is infinite. 
Contributed by Chandni Singh

(cherry picked from commit 47ad98b2e1)
 2018-10-19 13:49:51 -04:00
Wangda Tan 9ed9e185d7 YARN-8916. Define a constant docker string in ContainerRuntimeConstants.java for better maintainability. (Zhankun Tang via wangda) 
Change-Id: I1349e740037f81afdbe30edbe741f20e88fd0a90
(cherry picked from commit 5e02b4915b)
 2018-10-19 09:50:18 -07:00
Wangda Tan bd08554aa4 YARN-8908. Fix errors in yarn-default.xml related to GPU/FPGA. (Zhankun Tang via wangda) 
Change-Id: I46f511a9b51b65b069e15d5b827530110c41edab
(cherry picked from commit 071b9e19aa)
 2018-10-19 09:50:12 -07:00
Takanobu Asanuma ef073547dc HADOOP-15804. upgrade to commons-compress 1.18. Contributed by Akira Ajisaka. 
(cherry picked from commit 9bd18324c7)
 2018-10-19 21:40:32 +09:00
Weiwei Yang 042f2df19b YARN-8907. Fix incorrect logging message in TestCapacityScheduler. Contributed by Zhankun Tang. 
(cherry picked from commit 13cc0f50ea)
 2018-10-19 10:01:45 +08:00
Giovanni Matteo Fumarola 0b6a7b5f16 HDFS-14007. Incompatible layout when generating FSImage. Contributed by Inigo Goiri. 2018-10-18 17:26:22 -07:00
Inigo Goiri c0f618f3d5 HDFS-14002. TestLayoutVersion#testNameNodeFeatureMinimumCompatibleLayoutVersions fails. Contributed by Takanobu Asanuma. 
(cherry picked from commit be1cffb085)
 2018-10-18 17:14:56 -07:00
Eric Yang 91c916e209 YARN-8618. Added detection for non-upgradable service. 
Contributed by Chandni Singh

(cherry picked from commit 66f059ed1d)
 2018-10-18 20:00:50 -04:00
Giovanni Matteo Fumarola 1810f2392f HDFS-14005. RBF: Web UI update to bootstrap-3.3.7. Contributed by Inigo Goiri. 2018-10-18 14:35:20 -07:00
Wangda Tan 7252f8e117 YARN-8896. Limit the maximum number of container assignments per heartbeat. (Zhankun Tang via wangda) 
Change-Id: I6e72f8362bd7f5c2a844cb9e3c4732492314e9f1
(cherry picked from commit 780be14f07)
 2018-10-18 12:12:19 -07:00
Wangda Tan 5f7ed043c8 YARN-8456. Fix a configuration handling bug when user leave FPGA discover executable path configuration default but set OpenCL SDK path environment variable. (Zhankun Tang via wangda) 
Change-Id: Iff150ea98ba0c60d448474fd940eb121afce6965
(cherry picked from commit a457a8951a)
 2018-10-18 12:12:14 -07:00
Wangda Tan a7785d2764 YARN-6098. Add documentation for Delete Queue. (Suma Shivaprasad via wangda) 
Change-Id: I23bf7ca0acbe1168a7f805ceccdd62fe41bfeb35
(cherry picked from commit bfb88b10f4)
 2018-10-18 12:12:09 -07:00
Eric Yang 4681e17a36 YARN-8687. Update YARN service file type in documentation. 
Contributed by Suma Shivaprasad
 2018-10-18 12:04:04 -04:00
Sunil G bde4fd5ed9 Preparing for 3.2.0 release 2018-10-18 17:07:45 +05:30
Inigo Goiri 30b65ea18f HDFS-14000. RBF: Documentation should reflect right scripts for v3.0 and above. Contributed by CR Hota. 
(cherry picked from commit 7347fa2df3)
 2018-10-17 16:41:43 -07:00
Jason Lowe 30fc5966a2 HADOOP-15859. ZStandardDecompressor.c mistakes a class for an instance. Contributed by Jason Lowe 
(cherry picked from commit 9abda83947)
 2018-10-17 14:40:57 -05:00
Sunil G 6380ee5512 YARN-8759. Copy of resource-types.xml is not deleted if test fails, causes other test failures. Contributed by Antal Bálint Steinbach. 
(cherry picked from commit 5085e5fa9e)
 2018-10-17 16:06:07 +05:30
Steve Loughran 88ea877ac0
HADOOP-15861. Move DelegationTokenIssuer to the right path. 
Contributed by Wei-Chiu Chuang.

(cherry picked from commit 41b3603b5b)
 2018-10-17 11:02:47 +01:00
Xiao Chen 08b415d170 HDFS-13662. TestBlockReaderLocal#testStatisticsForErasureCodingRead is flaky 
(cherry picked from commit 533138718c)
 2018-10-16 19:34:41 -07:00
Akira Ajisaka 83769b63d4
HADOOP-15802. start-build-env.sh creates an invalid /etc/sudoers.d/hadoop-build-${USER_ID} file entry. Contributed by Jon Boone. 
(cherry picked from commit e3342a1aba)
 2018-10-17 10:14:30 +09:00
Eric Yang fc25def7d7 YARN-8810. Fixed a YARN service bug in comparing ConfigFile object. 
Contributed by Chandni Singh
 2018-10-16 18:57:50 -04:00
Wangda Tan 80ee60c88c YARN-8892. YARN UI2 doc changes to update security status (verified under security environment). (Sunil G via wangda) 
Change-Id: I8bc8622936861b8d6de3e42a0b75af86ad8a3961
(cherry picked from commit 538250db26)
 2018-10-16 13:53:08 -07:00
Wangda Tan aa23c8d739 YARN-8798. [Submarine] Job should not be submitted if --input_path option is missing. (Zhankun Tang via wangda) 
Change-Id: I7ae0e44eb5179b04a6ac861ec1c65f3b18c38f0f
(cherry picked from commit 143d74775b)
 2018-10-16 13:53:03 -07:00
Wangda Tan 920401b296 YARN-8870. [Submarine] Add submarine installation scripts. (Xun Liu via wangda) 
Change-Id: I46e8d9fd32c7745c313030da62da41486a77b3ea
(cherry picked from commit 46d6e00166)
 2018-10-16 13:52:58 -07:00
Wangda Tan 8610c20724 YARN-8875. [Submarine] Add documentation for submarine installation script details. (Xun Liu via wangda) 
Change-Id: I1c8d39c394e5a30f967ea514919835b951f2c124
(cherry picked from commit ed08dd3b0c)
 2018-10-16 13:52:53 -07:00
Steve Loughran c19864d8c8
HADOOP-15848. ITestS3AContractMultipartUploader#testMultipartUploadEmptyPart test error. 
Contributed by Ewan Higgs.
 2018-10-16 19:58:58 +01:00
Xiao Chen 424c99681b MAPREDUCE-7132. JobSplitWriter prints unnecessary warnings if EC(RS10,4) is used. Contributed by Peter Bacsko. 
(cherry picked from commit 25f8fcb064)
 2018-10-16 10:24:15 -07:00
Sunil G a439aa79dc YARN-8879. Kerberos principal is needed when submitting a submarine job. Contributed by Zac Zhou. 
(cherry picked from commit 753f149fd3)
 2018-10-16 22:18:30 +05:30
Márton Elek 7b06383163 HADOOP-15857. Addendum. Remove ozonefs class name definition from core-default.xml. Contributed by Elek, Marton. 2018-10-16 15:51:59 +02:00
Sunil G c5bf07154f HADOOP-15857. Remove ozonefs class name definition from core-default.xml. Contributed by Elek, Marton. 2018-10-16 18:56:49 +05:30
Xiao Chen ced2596094 HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. 
(cherry picked from commit b6fc72a025)
 2018-10-15 11:00:21 -07:00
Sunil G 1ca5f974f1 YARN-8869. YARN Service Client might not work correctly with RM REST API for Kerberos authentication. Contributed by Eric Yang. 
(cherry picked from commit fa94d370b6)
 2018-10-15 21:22:45 +05:30
bibinchundatt aff21d7271 YARN-8830. SLS tool fix node addition. Contributed by Bibin A Chundatt. 
(cherry picked from commit b4a38e7b3e)
 2018-10-15 18:11:01 +05:30
Vinayakumar B 8a41edb089 Fix potential FSImage corruption. Contributed by Daryn Sharp. 
(cherry picked from commit b60ca37914)
 2018-10-15 15:49:56 +05:30
Xiao Chen 9cb0654fbb HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. 
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.

(cherry picked from commit 5ec86b445c)
 2018-10-12 12:08:08 -07:00
Inigo Goiri 65c1469b1a HDFS-13802. RBF: Remove FSCK from Router Web UI. Contributed by Fei Hui. 
(cherry picked from commit f63ee083db)
 2018-10-12 10:10:52 -07:00
Vinayakumar B b185964b15 HDFS-13945. TestDataNodeVolumeFailure is Flaky. Contributed by Ayush Saxena. 
(cherry picked from commit 6e0e6daaf3)
 2018-10-12 17:34:28 +05:30
Vinayakumar B d838d39a2c HDFS-13156. HDFS Block Placement Policy - Client Local Rack. Contributed by Ayush Saxena. 
(cherry picked from commit de44e1064f)
 2018-10-12 17:28:48 +05:30
Vrushali C 62d329cac0 YARN-5742 Serve aggregated logs of historical apps from timeline service. Contributed by Rohith Sharma KS 
(cherry picked from commit 8d1981806f)
 2018-10-12 07:18:13 +05:30
Siyao Meng 551e911493 HDFS-13878. HttpFS: Implement GETSNAPSHOTTABLEDIRECTORYLIST. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 6dcfef79af)
 2018-10-11 15:04:02 -07:00
Siyao Meng 15e0ba3fb4 HDFS-13877. HttpFS: Implement GETSNAPSHOTDIFF. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 396ce0d9f4)
 2018-10-11 15:03:55 -07:00
Jason Lowe cdbca8b133 YARN-8861. executorLock is misleading in ContainerLaunch. Contributed by Chandni Singh 
(cherry picked from commit e787d65a08)
 2018-10-11 10:58:48 -05:00
Steve Loughran 70d39c74d9
HADOOP-15837. DynamoDB table Update can fail S3A FS init. 
Contributed by Steve Loughran.

(cherry picked from commit ee816f1fd7)
 2018-10-11 14:58:37 +01:00
Sunil G f29a7fdb14 YARN-8753. [UI2] Lost nodes representation missing from Nodemanagers Chart. Contributed by Yesha Vora. 
(cherry picked from commit 8a37983990)
 2018-10-11 16:16:05 +05:30
Sunil G 0bf0fb5499 YARN-8666. [UI2] Remove application tab from YARN Queue Page. Contributed by Yesha Vora. 
(cherry picked from commit d3da741fa2)
 2018-10-11 16:07:08 +05:30
Hrishikesh Gadre 90a9837c9d HDFS-13956. iNotify should include information to identify a file as either replicated or erasure coded. Contributed by Hrishikesh Gadre. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit bf3d591f0c)
 2018-10-10 10:24:23 -07:00
Weiwei Yang 966d94ea2f HDFS-12459. Fix revert: Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3ead525c71)
 2018-10-10 10:14:57 -07:00
Steve Loughran 1ee09906ce
HADOOP-15839. Review + update cloud store sensitive keys in hadoop.security.sensitive-config-keys. 
Contributed by Steve Loughran.

(cherry picked from commit cdc4350718)
 2018-10-10 17:02:00 +01:00
Jason Lowe 145c7aa663 YARN-7644. NM gets backed up deleting docker containers. Contributed by Chandni Singh 
(cherry picked from commit 5ce70e1211)
 2018-10-10 10:01:52 -05:00