Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,681 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

17681 Commits

Author SHA1 Message Date
Eric E Payne c5f2fb5ae6 HADOOP-15548: Randomize local dirs. Contributed by Jim Brennan. 
(cherry picked from commit d36f6b9e93)
 2018-06-29 18:35:47 +00:00
Jason Lowe 90631e6dbf YARN-8451. Multiple NM heartbeat thread created when a slow NM resync with RM. Contributed by Botong Huang 
(cherry picked from commit 100470140d)
 2018-06-29 13:14:20 -05:00
Sunil G 7dbe81895b YARN-8401. [UI2] new ui is not accessible with out internet connection. Contributed by Bibin A Chundatt. 
(cherry picked from commit fbaff369e9)
 2018-06-27 10:36:08 -07:00
Rohith Sharma K S 1fa79f0063 YARN-8457. Compilation is broken with -Pyarn-ui. 
(cherry picked from commit 4ffe68a6f7)
 2018-06-25 10:40:02 -07:00
Inigo Goiri f3efeb899a HADOOP-15458. TestLocalFileSystem#testFSOutputStreamBuilder fails on Windows. Contributed by Xiao Liang. 
(cherry picked from commit abc3e4bad9)
 2018-06-25 09:51:25 -07:00
Weiwei Yang 3151e95d27 YARN-8443. Total #VCores in cluster metrics is wrong when CapacityScheduler reserved some containers. Contributed by Tao Yang. 2018-06-25 09:46:32 +08:00
Eric E Payne e977876428 YARN-8444: NodeResourceMonitor crashes on bad swapFree value. Contributed by Jim Brennan. 
(cherry picked from commit 6432128622)
 2018-06-22 17:30:01 +00:00
Yiqun Lin db1f37a711 HDFS-13692. StorageInfoDefragmenter floods log when compacting StorageInfo TreeSet. Contributed by Bharat Viswanadham. 
(cherry picked from commit 30728aced4)
 2018-06-22 10:55:09 +08:00
Xiao Chen aca66f6155 HDFS-13682. Cannot create encryption zone after KMS auth token expires. 
(cherry picked from commit 32f867a6a9)
 2018-06-20 15:59:45 -07:00
Surendra Singh Lilhore 5667582bc4 HDFS-12857. StoragePolicyAdmin should support schema based path. Contributed by Surendra Singh Lilhore. 
(cherry picked from commit 30941d99c9)
 2018-06-19 10:09:05 -07:00
Chris Douglas d1dcc39222 HADOOP-15533. Make WASB listStatus messages consistent. Contributed by Esfandiar Manii 
(cherry picked from commit f34744603e)
(cherry picked from commit 7e655b642d)
 2018-06-17 23:13:25 -07:00
Surendra Singh Lilhore 34f89f5af7 HADOOP-15523. Shell command timeout given is in seconds whereas it is taken as millisec while scheduling. Contributed by Bilwa S T. 
(cherry picked from commit 3905fdb793)
 2018-06-17 12:49:09 +05:30
Inigo Goiri 11d3db2dba HDFS-13681. Fix TestStartup.testNNFailToStartOnReadOnlyNNDir test failure on Windows. Contributed by Xiao Liang. 
(cherry picked from commit 8762e9cf10)
 2018-06-15 16:50:20 -07:00
Inigo Goiri 69abd1fc5c HDFS-13686. Add overall metrics for FSNamesystemLock. Contributed by Lukas Majercak. 
(cherry picked from commit d31a3ce767)
 2018-06-15 16:00:16 -07:00
Wei-Chiu Chuang 73badce597 HDFS-13174. hdfs mover -p /path times out after 20 min. Contributed by Istvan Fajth. 
(cherry picked from commit c966a3837a)
(cherry picked from commit 975d4b3d60)
 2018-06-15 13:38:11 -07:00
Inigo Goiri fe1926a50f HDFS-13676. TestEditLogRace fails on Windows. Contributed by Zuoming Zhang. 
(cherry picked from commit eebeb6033f)
 2018-06-15 13:08:47 -07:00
Inigo Goiri 94e0b9839f HDFS-13673. TestNameNodeMetrics fails on Windows. Contributed by Zuoming Zhang. 
(cherry picked from commit 43d994e4a6)
 2018-06-15 10:34:33 -07:00
Inigo Goiri a3c0c03899 HDFS-13563. TestDFSAdminWithHA times out on Windows. Contributed by Lukas Majercak. 
(cherry picked from commit 8d4926f38b)
 2018-06-14 09:59:50 -07:00
Rohith Sharma K S 6542e31b78 YARN-8155. Improve ATSv2 client logging in RM and NM publisher. Contributed by Abhishek Modi. 
(cherry picked from commit 9119b3cf8f)
 2018-06-14 13:51:05 +05:30
Yiqun Lin b94b071b10 HDFS-13641. Add metrics for edit log tailing. Contributed by Chao Sun. 
(cherry picked from commit 8e7548d33b)
 2018-06-13 20:24:12 +08:00
Sunil G d9b00cdd6b YARN-8404. Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down. Contributed by Rohith Sharma K S 
(cherry picked from commit 6307962b93)
 2018-06-13 16:10:24 +05:30
Weiwei Yang ef105abb70 YARN-8394. Improve data locality documentation for Capacity Scheduler. Contributed by Weiwei Yang. 
(Cherry picked from commit 29024a6203)
 2018-06-13 13:57:35 +08:00
Inigo Goiri 189b6bac8c HADOOP-15532. TestBasicDiskValidator fails with NoSuchFileException. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit aeaf9fec62)
 2018-06-12 14:18:19 -07:00
Inigo Goiri fa9d4a7493 YARN-8422. TestAMSimulator failing with NPE. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit c35481594f)
 2018-06-12 11:01:22 -07:00
Inigo Goiri 6a31dc9927 HADOOP-15529. ContainerLaunch#testInvalidEnvVariableSubstitutionType is not supported in Windows. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit 6e756e8a62)
 2018-06-12 10:25:36 -07:00
Rohith Sharma K S 96e7b7e8ae YARN-8405. RM zk-state-store.parent-path ACLs has been changed since HADOOP-14773. Contributed by Íñigo Goiri. 
(cherry picked from commit 2df73dace0)
 2018-06-12 17:25:22 +05:30
Inigo Goiri 26ed145763 YARN-8370. Some Node Manager tests fail on Windows due to improper path/file separator. Contributed by Anbang Hu. 
(cherry picked from commit 2b2f672022)
 2018-06-11 19:26:58 -07:00
Steve Loughran df338f2e1a HADOOP-15506. Upgrade Azure Storage Sdk version to 7.0.0 and update corresponding code blocks. 
Contributed by Esfandiar Manii.

(cherry picked from commit d901be6795)
(cherry picked from commit baac7c2b28)
 2018-06-11 15:33:36 -07:00
Yongjun Zhang 8202c334fe Update CHANGES, RELEASENOTES, and jdiff for 3.0.3 release. 
(cherry picked from commit 5a82f10e32)
 2018-06-11 14:28:44 -07:00
Inigo Goiri 6eea6d28de HDFS-13653. Make dfs.client.failover.random.order a per nameservice configuration. Contributed by Ekanth Sethuramalingam. 
(cherry picked from commit 784dbbd2d1fc0c361fee851d3f9b3aa50be5481d)
 2018-06-11 11:18:04 -07:00
Sammi Chen b874110275 HADOOP-15499. Performance severe drops when running RawErasureCoderBenchmark with NativeRSRawErasureCoder. Contributed by Sammi Chen. 
(cherry picked from commit 18201b882a)
 2018-06-11 13:58:57 +08:00
Bharat Viswanadham 7c144e4ae4 HDFS-13667:Typo: Marking all datandoes as stale. Contributed by Nanda Kumar 
(cherry picked from commit ccfb816d39)
 2018-06-09 16:44:47 -07:00
Arpit Agarwal ea05171ceb HDFS-12670. can't renew HDFS tokens with only the hdfs client jar. Contributed by Arpit Agarwal. 2018-06-08 17:58:02 -07:00
Chao Sun d62b0f84f1 HDFS-13664. Refactor ConfiguredFailoverProxyProvider to make inheritance easier. Contributed by Chao Sun. 
(cherry picked from commit fba1c42adc)
 2018-06-08 16:42:18 -07:00
Inigo Goiri 500057c40c YARN-8359. Exclude containermanager.linux test classes on Windows. Contributed by Jason Lowe. 
(cherry picked from commit 3492a1db2c0654ce5375360caa74a34f928f23be)
 2018-06-07 17:10:38 -07:00
Brahma Reddy Battula a45e9812d6 HDFS-12950. [oiv] ls will fail in secure cluster. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit 9654dd1f47)
(cherry picked from commit 630f43faf7)
 2018-06-07 09:18:20 -07:00
Wei-Chiu Chuang 8e423a7779 HDFS-13659. Add more test coverage for contentSummary for snapshottable path. Contributed by Wei-Chiu Chuang. 
(cherry picked from commit e39b113db0)
(cherry picked from commit b2e919dc1a)
 2018-06-07 08:32:53 -07:00
Xiao Chen 3843abe482 HADOOP-15217. FsUrlConnection does not handle paths with spaces. Contributed by Joseph Fourny and Zsolt Venczel. 
(cherry picked from commit ba4011d64f)
 2018-06-05 21:19:19 -07:00
Inigo Goiri 49cfb11d8c MAPREDUCE-7103. Fix TestHistoryViewerPrinter on windows due to a mismatch line separator. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit 0afc036deb)
 2018-06-05 12:25:59 -07:00
Akira Ajisaka cc735146dc
HDFS-13545. "guarded" is misspelled as "gaurded" in FSPermissionChecker.java. Contributed by Jianchao Jia. 
(cherry picked from commit 0e3c31579d)
 2018-06-05 17:55:33 +09:00
Inigo Goiri e794ff2dcb HDFS-13650. Randomize baseDir for MiniDFSCluster in TestDFSStripedInputStream and TestDFSStripedInputStreamWithRandomECPolicy. Contributed by Anbang Hu. 
(cherry picked from commit 8d31ddcfeb)
 2018-06-04 18:29:12 -07:00
Inigo Goiri 076dc95c76 HDFS-13649. Randomize baseDir for MiniDFSCluster in TestReconstructStripedFile and TestReconstructStripedFileWithRandomECPolicy. Contributed by Anbang Hu. 
(cherry picked from commit 16316b6011)
 2018-06-04 18:22:35 -07:00
Inigo Goiri 2e5f849ea5 HDFS-13652. Randomize baseDir for MiniDFSCluster in TestBlockScanner. Contributed by Anbang Hu. 
(cherry picked from commit a28848104f)
 2018-06-04 18:13:50 -07:00
Bharat Viswanadham f1e1c068c0 HADOOP-15137. ClassNotFoundException: org.apache.hadoop.yarn.server.api.DistributedSchedulingAMProtocol when using hadoop-client-minicluster. Contributed by Bharat Viswanadham 
(cherry picked from commit f30f2dc408)
 2018-06-04 16:51:22 -07:00
Robert Kanter d5e6d0d5f4 YARN-4677. RMNodeResourceUpdateEvent update from scheduler can lead to race condition (wilfreds and gphillips via rkanter) 
(cherry picked from commit 0cd145a443)
 2018-06-04 15:42:46 -07:00
Inigo Goiri 9fe265f44e MAPREDUCE-7105. Fix TestNativeCollectorOnlyHandler.testOnCall on Windows because of the path format. Contributed by Giovanni Matteo Fumarola. 
(cherry picked from commit dad1bb868f)
 2018-06-04 12:57:11 -07:00
Miklos Szegedi a3afd69051 YARN-8382. cgroup file leak in NM. Contributed by Hu Ziqian. 
(cherry picked from commit 925fdf761a513130e23c10575c7328c8681cff1d)
 2018-06-04 11:07:08 -07:00
Rushabh Shah 4ecb7aaf77 HDFS-13281 Namenode#createFile should be /.reserved/raw/ aware.. Contributed by Rushabh S Shah 
(cherry picked from commit e2289c8d14)
 2018-06-04 09:58:38 -05:00
Wei-Chiu Chuang 63fc8f82cb HDFS-13155. BlockPlacementPolicyDefault.chooseTargetInOrder Not Checking Return Value for NULL. Contributed by Zsolt Venczel. 
(cherry picked from commit bccdfeee0a)
(cherry picked from commit 302c36ffdc)
 2018-06-04 07:04:32 -07:00
Xiao Chen 3ee5fd16f4 HDFS-13339. Volume reference can't be released and may lead to deadlock when DataXceiver does a check volume. Contributed by liaoyuxiangqin and Zsolt Venczel. 
(cherry picked from commit 9efb4b7db0)
 2018-06-03 22:37:36 -07:00