Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,530 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

15530 Commits

Author SHA1 Message Date
Akira Ajisaka 7d88a54d40 HADOOP-18040. Use maven.test.failure.ignore instead of ignoreTestFailure (#3774) 
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 9b9e2ef87f)

 Conflicts:
	hadoop-tools/hadoop-federation-balance/pom.xml

(cherry picked from commit 35c5c6bb83)

 Conflicts:
	hadoop-common-project/hadoop-registry/pom.xml

(cherry picked from commit 94ca965e21)
 2021-12-10 01:47:31 +09:00
Akira Ajisaka eda934025b HADOOP-18035. Ignore unit test failures to run all the unit tests from root (#3765) 
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
(cherry picked from commit 3854b59bd1)
 2021-12-10 01:27:38 +09:00
Ashutosh Gupta 0b9ae87ee7 YARN-9063. ATS 1.5 fails to start if RollingLevelDb files are corrupt or missing (#3728) 
Signed-off-by: Akira Ajisaka <aajisaka@apache.org>
(cherry picked from commit 5a950b8900)

 Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice/src/test/java/org/apache/hadoop/yarn/server/timeline/TestRollingLevelDBTimelineStore.java
 2021-12-06 20:22:35 +09:00
Sunil G 29f81c6121 YARN-9984. FSPreemptionThread can cause NullPointerException while app is unregistered with containers running on a node. Contributed by Wilfred Spiegelenburg. 
(cherry picked from commit 215f2052fc)

 Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FSPreemptionThread.java
 2021-11-29 14:35:47 +09:00
Shubham Gupta 484cac36fd YARN-10438. Handle null containerId in ClientRMService#getContainerReport() (#2313) 
Co-authored-by: Shubham Gupta <gshubham@microsoft.com>
(cherry picked from commit e3cd627069)
 2021-11-29 14:21:56 +09:00
Yufei Gu 68ac742d94 HADOOP-15331. Fix a race condition causing parsing error of java.io.BufferedInputStream in class org.apache.hadoop.conf.Configuration. Contributed by Miklos Szegedi. 
(cherry picked from commit 268c29a5f5)
 2021-11-29 14:13:05 +09:00
Eric Yang 0d88d832cd YARN-7266. Fixed deadlock in Timeline Server thread initialization. 
Contributed by Prabhu Joseph

(cherry picked from commit 7b42e0e32a)
 2021-11-29 12:43:05 +09:00
Abhishek Das f9463e5111 HADOOP-17999. No-op implementation of setWriteChecksum and setVerifyChecksum in ViewFileSystem. Contributed by Abhishek Das. (#3639) 
(cherry picked from commit 54a1d78e16)
 2021-11-16 22:28:10 -08:00
litao e648b3e34b HDFS-16311. Metric metadataOperationRate calculation error in DataNodeVolumeMetrics (#3636) 
Reviewed-by: Ayush Saxena <ayushsaxena@apache.org>
(cherry picked from commit 1c1cf64616)
 2021-11-12 10:27:17 +09:00
Gautham B A 1b50c55a21
HADOOP-17988. Disable JIRA plugin for YETUS on Hadoop (#3623) 2021-11-11 00:14:04 +05:30
litao feb5971f49 HDFS-16312. Fix typo for DataNodeVolumeMetrics and ProfilingFileIoEvents (#3637) 
Reviewed-by: Hui Fei <ferhui@apache.org>
(cherry picked from commit 2a1a11c039)
 2021-11-10 19:24:56 +09:00
litao 899c4802fc HDFS-16298. Improve error msg for BlockMissingException (#3615) 
Reviewed-by: Hui Fei <ferhui@apache.org>
(cherry picked from commit ea65fc26d8)
 2021-11-10 19:19:31 +09:00
jianghuazhu 64cd82e472 HDFS-16301. Improve BenchmarkThroughput#SIZE naming standardization. (#3622) 
(cherry picked from commit b307f18a58)
 2021-11-10 11:46:50 +09:00
Zhendong Bai eb6be306b4
HADOOP-17880. Build Hadoop on Centos 7 (#3535) 2021-11-08 17:45:12 +05:30
jianghuazhu f7ec214568 HDFS-16294.Remove invalid DataNode#CONFIG_PROPERTY_SIMULATED. (#3605) 
(cherry picked from commit 72718a8dc1)
 2021-11-04 16:57:35 +09:00
Gautham B A 3dd888023b
HADOOP-17978. Exclude ASF license check for pkg-resolver JSON (#3583) 2021-10-25 16:13:26 -07:00
Ahmed Hussein de120b16ad YARN-1115: Provide optional means for a scheduler to check real user ACLs. Contributed by Eric Payne (epayne) 2021-10-22 17:02:38 +00:00
Michael Kuchenbecker 79d1818879 HDFS-7612: Fix default cache directory in TestOfflineEditsViewer.testStored. Contributed by Michael Kuchenbecker (#3571) 
(cherry picked from commit a73ff6915a)
 2021-10-21 13:54:05 -07:00
Szilard Nemeth 5db1b2d7fa HADOOP-17857. Check real user ACLs in addition to proxied user ACLs. Contributed by Eric Payne 
(cherry picked from commit 5428d36b56)
 2021-10-21 17:40:02 +00:00
Masatake Iwasaki b4c8004db3
HADOOP-17965. Fix documentation build failure using JDK 7 on branch-2.10. (#3562) 2021-10-19 18:08:51 +09:00
Symious b7bb43f6db
HDFS-16257. Set initialCapacity for guava cache to solve performance issue (#3524) 
* HDFS-16257. Set initialCapacity for guava cache to solve performance issue

* HDFS-16257. Add comments

Co-authored-by: Symious <yiyang0203@gmail.com>
 2021-10-18 19:58:00 +09:00
Xing Lin 2565ec5804 HADOOP-16532. Fix TestViewFsTrash to use the correct homeDir. Contributed by Xing Lin. (#3514) 
(cherry picked from commit 97c0f96879)
 2021-10-13 14:59:38 -07:00
Weiwei Yang 5f2047d491 YARN-8222. Fix potential NPE when gets RMApp from RM context. Contributed by Tao Yang. 
(cherry picked from commit 251f528814)
 2021-10-12 17:43:43 +00:00
Masatake Iwasaki b8dc05efcd
HADOOP-17964. Increase Java heap size for running Maven in Dockerfile of branch-2.10. (#3545) 2021-10-13 00:53:03 +09:00
Weiwei Yang bdd396b26d YARN-8546. Resource leak caused by a reserved container being released more than once under async scheduling. Contributed by Tao Yang. 
(cherry picked from commit 5be9f4a5d0)
 2021-10-08 16:08:45 +00:00
Weiwei Yang dc03afc7df YARN-8127. Resource leak when async scheduling is enabled. Contributed by Tao Yang. 
(cherry picked from commit 7eb783e263)
 2021-10-04 20:16:40 +00:00
Wei-Chiu Chuang 6d11f7ae8c HDFS-16233. Do not use exception handler to implement copy-on-write for EnumCounters. (#3468) 
(cherry picked from commit 87632bbacf)
(cherry picked from commit bb08de559a)
(cherry picked from commit 978ec57445)
(cherry picked from commit cd7c34f9b4)
 2021-09-24 09:15:48 -07:00
Eric Badger 008bd8afc3 YARN-10935. AM Total Queue Limit goes below per-user AM Limit if parent is full. Contributed by Eric Payne. 2021-09-23 17:12:45 +00:00
Rintaro Ikeda 25d0a97557 HADOOP-17926. Maven-eclipse-plugin is no longer needed since Eclipse can import Maven projects by itself. (#3465) 
(cherry picked from commit 962068d2d8)
 2021-09-22 13:10:07 +00:00
Kihwal Lee 30f48c4d06 HDFS-16198. Short circuit read leaks Slot objects when InvalidToken exception is thrown (#3359) 
Reviewed-by: He Xiaoqiao <hexiaoqiao@apache.org>
Reviewed-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit c4c5883d8b)
 2021-09-15 14:45:28 -05:00
wangzhaohui 79c1a93bd7 HDFS-16181. [SBN Read] Fix display of JournalNode metric RpcRequestCacheMissAmount (#3317) 
Co-authored-by: wangzhaohui8 <wangzhaohui8@jd.com>

(cherry picked from commit 232fd7cae170de8c6b52c14841a47dca8735c6d2)
(cherry picked from commit 2f73ac1c14)
(cherry picked from commit 928dbac0a6)
(cherry picked from commit 9b63f601d3)
 2021-09-15 10:10:33 -07:00
Surendra Singh Lilhore edc138186f HDFS-14216. NullPointerException happens in NamenodeWebHdfs. Contributed by lujie. 
(cherry picked from commit 92b53c40f0)
(cherry picked from commit 2e939515df)
 2021-09-10 15:35:49 -07:00
Ahmed Hussein 7f32a31abf HDFS-16207. Remove NN logs stack trace for non-existent xattr query (#3375) 
Change-Id: Ibde523b20a6b8ac92991da52583e625a018d2ee6
 2021-09-09 21:34:04 +00:00
Masatake Iwasaki ba86e01336 HADOOP-17897. Allow nested blocks in switch case in checkstyle settings. (#3394) 
(cherry picked from commit e183ec8998)
 2021-09-08 15:14:24 +09:00
Ahmed Hussein 42599f6c8f
HADOOP-17885. Upgrade JSON smart to 1.3.3 on branch-2.10 (#3370) 2021-09-02 16:40:06 -05:00
Ahmed Hussein d636420e7c HADOOP-17886. Upgrade ant to 1.10.11 (#3371) 
(cherry picked from commit 051207375b)
 2021-09-02 16:22:23 -05:00
Pranav Bheda bc8069ac48
HADOOP-17223 update org.apache.httpcomponents:httpclient to 4.5.13 and httpcore to 4.4.13 (#2242) 
* update org.apache.httpcomponents:httpclient from 4.5.6 to 4.5.13
* update org.apache.httpcomponents:httpcore from 4.4.10 to 4.4.13

(cherry picked from commit be3edd0532)

This closes #3363
 2021-09-01 18:29:53 +09:00
Akira Ajisaka 126b314ae8
HADOOP-15584. Move httpcomponents versions in pom.xml. Contributed by Brandon Scheller. 
(cherry picked from commit 76d0365190)
 2021-09-01 18:28:03 +09:00
Szilard Nemeth b196130c29
YARN-10428. Zombie applications in the YARN queue using FAIR + sizebasedweight. Contributed by Guang Yang, Andras Gyori 
(cherry picked from commit 79a46599f7)

 Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/policy/TestFairOrderingPolicy.java

(cherry picked from commit 7aea2e1b5c)
 2021-09-01 13:16:30 +09:00
Abhishek Modi b79cd11fcd YARN-9744. RollingLevelDBTimelineStore.getEntityByTime fails with NPE. Contributed by Prabhu Joseph. 
(cherry picked from commit b4097b96a3)
 2021-08-18 17:54:10 -05:00
Akira Ajisaka bd7e20527e
HADOOP-17370. Upgrade commons-compress to 1.21 2021-08-08 11:37:11 +09:00
Akira Ajisaka d07955ce50
Fix potential heap buffer overflow in hdfs.c. Contributed by Igor Chervatyuk. 
(cherry picked from commit 4972e7a246)
 2021-08-07 11:46:30 +09:00
Chris Douglas f856092bdb MAPREDUCE-7011. TestClientDistributedCacheManager::testDetermineCacheVisibilities assumes all parent dirs set other exec 
(cherry picked from commit 782ba3bf9d)
 2021-08-03 21:00:44 +00:00
hchaverr 2187c6d366 HADOOP-17819. Add extensions to ProtobufRpcEngine RequestHeaderProto. Contributed by Hector Sandoval Chaverri. (#3242) 
(cherry picked from commit 3c8a48e681)
 2021-07-28 16:04:46 -07:00
Viraj Jasani 5e65126e38 HADOOP-17813. Checkstyle - Allow line length: 100 
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 98412ce2e1)
 2021-07-22 15:33:09 -05:00
zhuqi-lucas 34acf9d4c8 YARN-10860. Make max container per heartbeat configs refreshable. Contributed by Eric Badger. 2021-07-21 15:35:45 +08:00
Abhishek Das 99b952fcb4 HADOOP-17028. ViewFS should initialize mounted target filesystems lazily. Contributed by Abhishek Das (#2260, #3218) 
(cherry picked from commit 1dd03cc4b5)
 2021-07-20 18:26:24 -07:00
Jim Brennan 39c8297350 HDFS-16042. DatanodeAdminMonitor scan should be delay based. Contributed by Ahmed Hussein. 2021-07-15 21:13:25 +00:00
Jim Brennan 577ed175f9 YARN-10456. RM PartitionQueueMetrics records are named QueueMetrics in Simon metrics registry. Contributed by Eric Payne. 2021-07-15 15:21:02 +00:00
Akira Ajisaka 992d2c5f4e
HADOOP-12665. Document hadoop.security.token.service.use_ip. (#3187) 
Reviewed-by: Masatake Iwasaki <iwasakims@apache.org>
Reviewed-by: Chris Nauroth <cnauroth@apache.org>
(cherry picked from commit c81f82e21d)
 2021-07-12 10:19:06 +09:00