Apache
/
hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,892 Commits 326 Branches 371 Tags 1.5 GiB
Commit Graph

18892 Commits

Author SHA1 Message Date
Sammi Chen 7d71b3a1cc HDFS-13540. DFSStripedInputStream should only allocate new buffers when reading. Contributed by Xiao Chen. 
(cherry picked from commit 34e8b9f9a8)
 2018-05-23 19:12:04 +08:00
Akira Ajisaka fc4c20fc34
Additional check when unpacking archives. Contributed by Jason Lowe and Akira Ajisaka. 
(cherry picked from commit 745f203e57)
 2018-05-23 17:18:19 +09:00
Andrew Wang d47c0fc39a HDFS-13601. Optimize ByteString conversions in PBHelper. 
(cherry picked from commit 1d2640b613)
 2018-05-22 23:55:35 -07:00
Wangda Tan 2bbf1b4435 YARN-8332. Incorrect min/max allocation property name in resource types doc. (Weiwei Yang via wangda) 
Change-Id: If74f1ceed9c045a2cb2d6593741278b65ac44a9f
(cherry picked from commit 83f53e5c62)
 2018-05-22 13:39:20 -07:00
Wangda Tan 6aaf33e50c YARN-8290. SystemMetricsPublisher.appACLsUpdated should be invoked after application information is published to ATS to avoid "User is not set in the application report" Exception. (Eric Yang via wangda) 
Change-Id: I0ac6ddd19740d1aa7dd07111cd11af71ddc2fcaf
(cherry picked from commit bd15d2396e)
 2018-05-22 13:39:15 -07:00
Eric Yang 7c3f236783 YARN-7960. Added security flag no-new-privileges for YARN Docker integration. 
Contributed by Eric Badger

(cherry picked from commit 6176d2b35c)
 2018-05-22 13:47:08 -04:00
Kihwal Lee 6b8a5af6ef HADOOP-15450. Avoid fsync storm triggered by DiskChecker and handle disk full situation. Contributed by Arpit Agarwal. 
(cherry picked from commit bcc8e76bad)
 2018-05-22 11:22:22 -05:00
Jason Lowe 9788c8c01e YARN-8206. Sending a kill does not immediately kill docker containers. Contributed by Eric Badger 
(cherry picked from commit 5f11288e41)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/containermanager/linux/runtime/TestDockerContainerRuntime.java
 2018-05-22 09:49:31 -05:00
Eric E Payne 5b2bbff141 YARN-8179: Preemption does not happen due to natural_termination_factor when DRF is used. Contributed by Kyungwan Nam. 
(cherry picked from commit 0b4c44bdee)
 2018-05-21 20:19:44 +00:00
Rushabh Shah 1c594639f1 Skip the proxy user check if the ugi has not been initialized. Contributed by Daryn Sharp 
(cherry picked from commit 73e9120ad7)
 2018-05-21 12:39:59 -05:00
Steve Loughran a89e65faa0 HADOOP-15478. WASB: hflush() and hsync() regression. 
Contributed by Thomas Marquardt.

(cherry picked from commit ba842847c9)
 2018-05-21 11:13:18 +01:00
Eric Yang 61e8974049 YARN-7530. Refactored YARN service API project location. 
Contributed by Chandni Singh
 2018-05-18 17:33:18 -04:00
Inigo Goiri 8a86269c51 HDFS-13593. TestBlockReaderLocalLegacy#testBlockReaderLocalLegacyWithAppend fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 9775ecb235)
 2018-05-18 09:46:29 -07:00
Inigo Goiri da5eff8325 HDFS-13592. TestNameNodePrunesMissingStorages#testNameNodePrunesUnreportedStorages does not shut down cluster properly. Contributed by Anbang Hu. 
(cherry picked from commit 57b893de3d)
 2018-05-18 09:38:23 -07:00
Inigo Goiri 472495ed1e HDFS-13586. Fsync fails on directories on Windows. Contributed by Lukas Majercack. 
(cherry picked from commit 8783613696)
 2018-05-17 19:27:23 -07:00
Eric Yang 0791785574 YARN-8296. Removed unique_component_support from YARN services. 
Contributed by Suma Shivaprasad

(cherry picked from commit 2f2dd22aad)
 2018-05-17 20:59:50 -04:00
Eric Yang 79351d4fda YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag. 
Contributed by Chandni Singh

(cherry picked from 989cfdc1e0)
 2018-05-17 20:57:14 -04:00
Inigo Goiri df54cdbaea HDFS-13560. Insufficient system resources exist to complete the requested service for some tests on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 53b807a6a8)
 2018-05-17 17:03:56 -07:00
Inigo Goiri f67865ed7e HDFS-13556. TestNestedEncryptionZones does not shut down cluster. Contributed by Anbang Hu. 
(cherry picked from commit a97a2042f2)
 2018-05-17 16:53:53 -07:00
Inigo Goiri 8c463a2a9c HDFS-13554. TestDatanodeRegistration#testForcedRegistration does not shut down cluster. Contributed by Anbang Hu. 
(cherry picked from commit 65476458fa)
 2018-05-17 14:48:40 -07:00
Eric Yang aafaa5f99b YARN-8141. Removed YARN_CONTAINER_RUNTIME_DOCKER_LOCAL_RESOURCE_MOUNTS flag. 
Contributed by Chandni Singh

(cherry-picked from commit d45a0b7d73)
 2018-05-17 17:32:29 -04:00
Eric Yang 044573b628 YARN-8080. Add restart policy for YARN services. 
Contributed by Suma Shivaprasad

(cherry picked from commit 7f083ed869)
 2018-05-17 17:20:45 -04:00
Eric Yang c6c3b0afa0 YARN-8293. Removed "User Name for service" for deploying secure YARN service. 
Contributed by Sunil G

(cherry picked from commit 7802af6e9a)
 2018-05-17 17:07:55 -04:00
Inigo Goiri e5ff9f3922 HDFS-13558. TestDatanodeHttpXFrame does not shut down cluster. Contributed by Anbang Hu. 
(cherry picked from commit 26f1e22fc9)
 2018-05-17 13:35:40 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.) 0460201c3a YARN-8128. Documenting the per-node per-app file limit in YARN log aggregation. Contributed by Xuan Gong. 
(cherry picked from commit 328f0847e3)
 2018-05-17 13:09:09 -07:00
Steve Loughran 170f1040d4 HADOOP-15469. S3A directory committer commit job fails if _temporary directory created under dest. 
Contributed by Steve Loughran.
 2018-05-17 19:08:05 +01:00
Steve Loughran f729faaabb HADOOP-15250. Split-DNS MultiHomed Server Network Cluster Network IPC Client Bind Addr Wrong 
Contributed by Ajay Kumar

(cherry picked from commit 8f42dafcf8)
 2018-05-17 10:14:27 -07:00
Inigo Goiri b0c89690ed HDFS-13570. TestQuotaByStorageType,TestQuota,TestDFSOutputStream fail on Windows. Contributed by Anbang Hu. 
(cherry picked from commit c0ec061e28)
 2018-05-17 09:22:29 -07:00
Kihwal Lee 4f1ec6a515 HDFS-13581. DN UI logs link is broken when https is enabled. Contributed by Shashikant Banerjee. 
(cherry picked from commit 0ce6290de6)
 2018-05-17 09:26:13 -05:00
Rohith Sharma K S 4222e8f21b YARN-8297. Incorrect ATS Url used for Wire encrypted cluster. Contributed by Sunil G. 
(cherry picked from commit c95795cd8f)
 2018-05-17 16:25:38 +05:30
Inigo Goiri 1d1806f862 HDFS-13559. TestBlockScanner does not close TestContext properly. Contributed by Anbang Hu. 
(cherry picked from commit 454de3b543)
 2018-05-16 19:23:33 -07:00
Arpit Agarwal 45dd200a2c HDFS-13512. WebHdfs getFileStatus doesn't return ecPolicy. Contributed by Ajay Kumar. 2018-05-16 11:28:51 -07:00
Inigo Goiri e12ddd9394 HDFS-13550.TestDebugAdmin#testComputeMetaCommand fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 55d5549087)
 2018-05-16 10:09:18 -07:00
Eric Yang 2c3f300464 YARN-8300. Fixed NPE in DefaultUpgradeComponentsFinder. 
Contributed by Suma Shivaprasad

(cherry picked from 91357c22ef)
 2018-05-16 12:42:22 -04:00
Inigo Goiri 5310542fb4 HDFS-13557. TestDFSAdmin#testListOpenFiles fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 6b67161ca3)
 2018-05-16 09:32:15 -07:00
Jason Lowe 79b2a508e0 YARN-8284. get_docker_command refactoring. Contributed by Eric Badger 
(cherry picked from commit d47c09dcb1)
 2018-05-16 09:34:24 -05:00
Eric Yang 051d9cff9c YARN-8081. Add support to upgrade a component. 
Contributed by Chandni Singh

(cherry picked from commit 8d3b39de89)
 2018-05-15 20:42:24 -04:00
Inigo Goiri 899a7ec2fb HDFS-13567. TestNameNodeMetrics#testGenerateEDEKTime,TestNameNodeMetrics#testResourceCheck should use a different cluster basedir. Contributed by Anbang Hu. 
(cherry picked from commit 63480976a0)
 2018-05-15 15:36:03 -07:00
Inigo Goiri 34fbc1c2eb HDFS-13548. TestResolveHdfsSymlink#testFcResolveAfs fails on Windows. Contributed by Anbang Hu. 
(cherry picked from commit 2d6195c0af)
 2018-05-15 11:21:44 -07:00
Inigo Goiri c168329cc4 HDFS-11700. TestHDFSServerPorts#testBackupNodePorts doesn't pass on Windows. Contributed by Anbang Hu. 
(cherry picked from commit eaca7980ad)
 2018-05-15 10:28:01 -07:00
Inigo Goiri 583b9b418a HDFS-13551. TestMiniDFSCluster#testClusterSetStorageCapacity does not shut down cluster. Contributed by Anbang Hu. 
(cherry picked from commit 92ebd466c7)
 2018-05-15 10:22:19 -07:00
Steve Loughran a0cb1e0941 HADOOP-15442. ITestS3AMetrics.testMetricsRegister can't know metrics source's name. 
Contributed by Sean Mackrory.

(cherry picked from commit b670837469)
 2018-05-15 16:15:13 +01:00
Weiwei Yang 2bb39330a4 YARN-8278. DistributedScheduling is not working in HA. Contributed by Bibin A Chundatt. 
(Cherry picked from commit 2bb647bb91)
 2018-05-15 18:47:15 +08:00
Sunil G 0a30a548f1 YARN-8236. Invalid kerberos principal file name cause NPE in native service. Contributed by Gour Saha. 
(cherry picked from commit 58b97c79e3)
 2018-05-15 12:18:09 +05:30
Sunil G d997959560 YARN-8166. [UI2] Service page header links are broken. Contributed by Yesha Vora. 
(cherry picked from commit ffb9210ded)
 2018-05-15 12:13:44 +05:30
Sunil G d0452370cc YARN-8266. [UI2] Clicking on application from cluster view should redirect to application attempt page. Contributed by Yesha Vora. 
(cherry picked from commit 796b2b0ee3)
 2018-05-15 12:02:40 +05:30
Haibo Chen 8d3598525d YARN-8130 Race condition when container events are published for KILLED applications. (Rohith Sharma K S via Haibo Chen) 
(cherry picked from commit 2d00a0c71b)
 2018-05-15 11:40:47 +05:30
Hanisha Koneru 4f55941390 HDFS-13544. Improve logging for JournalNode in federated cluster. 
(cherry picked from commit 6beb25ab7e)
 2018-05-14 10:14:38 -07:00
Xiao Chen 6e731eb20d HDFS-13539. DFSStripedInputStream NPE when reportCheckSumFailure. 
(cherry picked from commit 960940e0e0)
 2018-05-14 09:29:14 -07:00
Naganarasimha 26e8fdffd6 YARN-8288. Fix wrong number of table columns in Resource Model doc. Contributed by Weiwei Yang. 
(cherry picked from commit 8a2b5914f3)
 2018-05-15 00:10:58 +08:00