Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
20,702 Commits 326 Branches 371 Tags
Commit Graph

20702 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Rohith Sharma K S
660fff3138 YARN-8826. Fix lingering timeline collector after serviceStop in TimelineCollectorManager. Contributed by Prabha Manepalli. 
(cherry picked from commit 0b62983c5a9361eb832784f134f140f9926c9ec6)
 2018-10-23 14:06:13 +05:30
Sunil G
30998fea28 YARN-8868. Set HTTPOnly attribute to Cookie. Contributed by Chandni Singh. 
(cherry picked from commit 2202e00ba8a44ad70f0a90e6c519257e3ae56a36)
 2018-10-23 09:57:26 +05:30
Arpit Agarwal
28a1cabb72 HDFS-13941. make storageId in BlockPoolTokenSecretManager.checkAccess optional. Contributed by Ajay Kumar. 
(cherry picked from commit c58811c77d5c0442c404a5b2876e09eaf6d16073)
 2018-10-22 14:45:11 -07:00
Steve Loughran
85bf008405
HADOOP-15866. Renamed HADOOP_SECURITY_GROUP_SHELL_COMMAND_TIMEOUT keys break compatibility. 
Contributed by Wei-Chiu Chuang.

(cherry picked from commit cb8d11e7bf5055508949a6a4f074efacc8cb1305)
 2018-10-22 11:08:30 +01:00
Sunil G
8724c2900f YARN-7502. Nodemanager restart docs should describe nodemanager supervised property. Contributed by Suma Shivaprasad. 
(cherry picked from commit e50334513c781a10368e7353bec6674f89eb0a7b)
 2018-10-22 14:16:24 +05:30
Ted Yu
a7dd244a49 HADOOP-15850. CopyCommitter#concatFileChunks should check that the blocks per chunk is not 0. Contributed by Ted Yu. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit e2cecb681e2aab8b7c5465719cac53dce407a64c)
 2018-10-19 13:22:01 -07:00
Eric Yang
04600cf5da YARN-8910. Fixed misleading log statement when container max retries is infinite. 
Contributed by Chandni Singh

(cherry picked from commit 47ad98b2e1b4e9ad9304aca4d452da428778e7ee)
 2018-10-19 13:49:51 -04:00
Wangda Tan
9ed9e185d7 YARN-8916. Define a constant docker string in ContainerRuntimeConstants.java for better maintainability. (Zhankun Tang via wangda) 
Change-Id: I1349e740037f81afdbe30edbe741f20e88fd0a90
(cherry picked from commit 5e02b4915b876eab943b30cf728cfc26ba832188)
 2018-10-19 09:50:18 -07:00
Wangda Tan
bd08554aa4 YARN-8908. Fix errors in yarn-default.xml related to GPU/FPGA. (Zhankun Tang via wangda) 
Change-Id: I46f511a9b51b65b069e15d5b827530110c41edab
(cherry picked from commit 071b9e19aa2c17bb9fa046c6ddabd6b8f0cc6d14)
 2018-10-19 09:50:12 -07:00
Takanobu Asanuma
ef073547dc HADOOP-15804. upgrade to commons-compress 1.18. Contributed by Akira Ajisaka. 
(cherry picked from commit 9bd18324c7801472409d9ad69ea365aa7a33a9c4)
 2018-10-19 21:40:32 +09:00
Weiwei Yang
042f2df19b YARN-8907. Fix incorrect logging message in TestCapacityScheduler. Contributed by Zhankun Tang. 
(cherry picked from commit 13cc0f50ea1c5f8978455e34f49716ddb0e3a143)
 2018-10-19 10:01:45 +08:00
Giovanni Matteo Fumarola
0b6a7b5f16 HDFS-14007. Incompatible layout when generating FSImage. Contributed by Inigo Goiri. 2018-10-18 17:26:22 -07:00
Inigo Goiri
c0f618f3d5 HDFS-14002. TestLayoutVersion#testNameNodeFeatureMinimumCompatibleLayoutVersions fails. Contributed by Takanobu Asanuma. 
(cherry picked from commit be1cffb0854cb28967beb062e9db7d61e6eeff1d)
 2018-10-18 17:14:56 -07:00
Eric Yang
91c916e209 YARN-8618. Added detection for non-upgradable service. 
Contributed by Chandni Singh

(cherry picked from commit 66f059ed1db93c0a86e86c64636013001169a677)
 2018-10-18 20:00:50 -04:00
Giovanni Matteo Fumarola
1810f2392f HDFS-14005. RBF: Web UI update to bootstrap-3.3.7. Contributed by Inigo Goiri. 2018-10-18 14:35:20 -07:00
Wangda Tan
7252f8e117 YARN-8896. Limit the maximum number of container assignments per heartbeat. (Zhankun Tang via wangda) 
Change-Id: I6e72f8362bd7f5c2a844cb9e3c4732492314e9f1
(cherry picked from commit 780be14f07df2a3ed6273b96ae857c278fd72718)
 2018-10-18 12:12:19 -07:00
Wangda Tan
5f7ed043c8 YARN-8456. Fix a configuration handling bug when user leave FPGA discover executable path configuration default but set OpenCL SDK path environment variable. (Zhankun Tang via wangda) 
Change-Id: Iff150ea98ba0c60d448474fd940eb121afce6965
(cherry picked from commit a457a8951a1b35f06811c40443ca44bb9c698c30)
 2018-10-18 12:12:14 -07:00
Wangda Tan
a7785d2764 YARN-6098. Add documentation for Delete Queue. (Suma Shivaprasad via wangda) 
Change-Id: I23bf7ca0acbe1168a7f805ceccdd62fe41bfeb35
(cherry picked from commit bfb88b10f46a265aa38ab3e1d87b6a0a99d94be8)
 2018-10-18 12:12:09 -07:00
Eric Yang
4681e17a36 YARN-8687. Update YARN service file type in documentation. 
Contributed by Suma Shivaprasad
 2018-10-18 12:04:04 -04:00
Sunil G
bde4fd5ed9 Preparing for 3.2.0 release 2018-10-18 17:07:45 +05:30
Inigo Goiri
30b65ea18f HDFS-14000. RBF: Documentation should reflect right scripts for v3.0 and above. Contributed by CR Hota. 
(cherry picked from commit 7347fa2df3cfd48857f4ded3539a60101d026daf)
 2018-10-17 16:41:43 -07:00
Jason Lowe
30fc5966a2 HADOOP-15859. ZStandardDecompressor.c mistakes a class for an instance. Contributed by Jason Lowe 
(cherry picked from commit 9abda83947a5babfe5a650b3409ad952f6782105)
 2018-10-17 14:40:57 -05:00
Sunil G
6380ee5512 YARN-8759. Copy of resource-types.xml is not deleted if test fails, causes other test failures. Contributed by Antal Bálint Steinbach. 
(cherry picked from commit 5085e5fa9e8c7e489a8518e8541c12b14f3651df)
 2018-10-17 16:06:07 +05:30
Steve Loughran
88ea877ac0
HADOOP-15861. Move DelegationTokenIssuer to the right path. 
Contributed by Wei-Chiu Chuang.

(cherry picked from commit 41b3603b5bcb74a7d78a314a4a5c177d941af27f)
 2018-10-17 11:02:47 +01:00
Xiao Chen
08b415d170 HDFS-13662. TestBlockReaderLocal#testStatisticsForErasureCodingRead is flaky 
(cherry picked from commit 533138718cc05b78e0afe583d7a9bd30e8a48fdc)
 2018-10-16 19:34:41 -07:00
Akira Ajisaka
83769b63d4
HADOOP-15802. start-build-env.sh creates an invalid /etc/sudoers.d/hadoop-build-${USER_ID} file entry. Contributed by Jon Boone. 
(cherry picked from commit e3342a1abaff71823ebd952baf24a6143e711b99)
 2018-10-17 10:14:30 +09:00
Eric Yang
fc25def7d7 YARN-8810. Fixed a YARN service bug in comparing ConfigFile object. 
Contributed by Chandni Singh
 2018-10-16 18:57:50 -04:00
Wangda Tan
80ee60c88c YARN-8892. YARN UI2 doc changes to update security status (verified under security environment). (Sunil G via wangda) 
Change-Id: I8bc8622936861b8d6de3e42a0b75af86ad8a3961
(cherry picked from commit 538250db26ce0b261bb74053348cddfc2d65cf52)
 2018-10-16 13:53:08 -07:00
Wangda Tan
aa23c8d739 YARN-8798. [Submarine] Job should not be submitted if --input_path option is missing. (Zhankun Tang via wangda) 
Change-Id: I7ae0e44eb5179b04a6ac861ec1c65f3b18c38f0f
(cherry picked from commit 143d74775b2b62884090fdd88874134b9eab2888)
 2018-10-16 13:53:03 -07:00
Wangda Tan
920401b296 YARN-8870. [Submarine] Add submarine installation scripts. (Xun Liu via wangda) 
Change-Id: I46e8d9fd32c7745c313030da62da41486a77b3ea
(cherry picked from commit 46d6e0016610ced51a76189daeb3ad0e3dbbf94c)
 2018-10-16 13:52:58 -07:00
Wangda Tan
8610c20724 YARN-8875. [Submarine] Add documentation for submarine installation script details. (Xun Liu via wangda) 
Change-Id: I1c8d39c394e5a30f967ea514919835b951f2c124
(cherry picked from commit ed08dd3b0c9cec20373e8ca4e34d6526bd759943)
 2018-10-16 13:52:53 -07:00
Steve Loughran
c19864d8c8
HADOOP-15848. ITestS3AContractMultipartUploader#testMultipartUploadEmptyPart test error. 
Contributed by Ewan Higgs.
 2018-10-16 19:58:58 +01:00
Xiao Chen
424c99681b MAPREDUCE-7132. JobSplitWriter prints unnecessary warnings if EC(RS10,4) is used. Contributed by Peter Bacsko. 
(cherry picked from commit 25f8fcb06476938826cdc92858a61124b18cd98d)
 2018-10-16 10:24:15 -07:00
Sunil G
a439aa79dc YARN-8879. Kerberos principal is needed when submitting a submarine job. Contributed by Zac Zhou. 
(cherry picked from commit 753f149fd3f5acf9a98cfc780d7899e307c19002)
 2018-10-16 22:18:30 +05:30
Márton Elek
7b06383163 HADOOP-15857. Addendum. Remove ozonefs class name definition from core-default.xml. Contributed by Elek, Marton. 2018-10-16 15:51:59 +02:00
Sunil G
c5bf07154f HADOOP-15857. Remove ozonefs class name definition from core-default.xml. Contributed by Elek, Marton. 2018-10-16 18:56:49 +05:30
Xiao Chen
ced2596094 HADOOP-14445. Addendum: Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. 
(cherry picked from commit b6fc72a0250ac3f2341ebe8a14d19b073e6224c8)
 2018-10-15 11:00:21 -07:00
Sunil G
1ca5f974f1 YARN-8869. YARN Service Client might not work correctly with RM REST API for Kerberos authentication. Contributed by Eric Yang. 
(cherry picked from commit fa94d370b6e3cba9c7560c09b517583e6652f103)
 2018-10-15 21:22:45 +05:30
bibinchundatt
aff21d7271 YARN-8830. SLS tool fix node addition. Contributed by Bibin A Chundatt. 
(cherry picked from commit b4a38e7b3e530756fb79d23dd4e218beeb5e3190)
 2018-10-15 18:11:01 +05:30
Vinayakumar B
8a41edb089 Fix potential FSImage corruption. Contributed by Daryn Sharp. 
(cherry picked from commit b60ca37914b22550e3630fa02742d40697decb31)
 2018-10-15 15:49:56 +05:30
Xiao Chen
9cb0654fbb HADOOP-14445. Use DelegationTokenIssuer to create KMS delegation tokens that can authenticate to all KMS instances. 
Contributed by Daryn Sharp, Xiao Chen, Rushabh S Shah.

(cherry picked from commit 5ec86b445cc492f52c33639efb6a09a0d2f27475)
 2018-10-12 12:08:08 -07:00
Inigo Goiri
65c1469b1a HDFS-13802. RBF: Remove FSCK from Router Web UI. Contributed by Fei Hui. 
(cherry picked from commit f63ee083db7c261207b726f0f44be2e5a92124f3)
 2018-10-12 10:10:52 -07:00
Vinayakumar B
b185964b15 HDFS-13945. TestDataNodeVolumeFailure is Flaky. Contributed by Ayush Saxena. 
(cherry picked from commit 6e0e6daaf3215213c32cdffa79f3730d40e981ea)
 2018-10-12 17:34:28 +05:30
Vinayakumar B
d838d39a2c HDFS-13156. HDFS Block Placement Policy - Client Local Rack. Contributed by Ayush Saxena. 
(cherry picked from commit de44e1064f051248934ceffdd98a3cc13653d886)
 2018-10-12 17:28:48 +05:30
Vrushali C
62d329cac0 YARN-5742 Serve aggregated logs of historical apps from timeline service. Contributed by Rohith Sharma KS 
(cherry picked from commit 8d1981806feb8278966c02a9eff42d72541bb35e)
 2018-10-12 07:18:13 +05:30
Siyao Meng
551e911493 HDFS-13878. HttpFS: Implement GETSNAPSHOTTABLEDIRECTORYLIST. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 6dcfef79afe97eda6d09fe2567bb4d4074223141)
 2018-10-11 15:04:02 -07:00
Siyao Meng
15e0ba3fb4 HDFS-13877. HttpFS: Implement GETSNAPSHOTDIFF. Contributed by Siyao Meng. 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 396ce0d9f470a5e8af03987ad6396d0f08b3d225)
 2018-10-11 15:03:55 -07:00
Jason Lowe
cdbca8b133 YARN-8861. executorLock is misleading in ContainerLaunch. Contributed by Chandni Singh 
(cherry picked from commit e787d65a08f5d5245d2313fc34f2dde518bfaa5b)
 2018-10-11 10:58:48 -05:00
Steve Loughran
70d39c74d9
HADOOP-15837. DynamoDB table Update can fail S3A FS init. 
Contributed by Steve Loughran.

(cherry picked from commit ee816f1fd78b029b9efa567e8b1b62391563de14)
 2018-10-11 14:58:37 +01:00
Sunil G
f29a7fdb14 YARN-8753. [UI2] Lost nodes representation missing from Nodemanagers Chart. Contributed by Yesha Vora. 
(cherry picked from commit 8a379839909197690af170afc13c49ef7aa54286)
 2018-10-11 16:16:05 +05:30