Commit Graph

12607 Commits

Author SHA1 Message Date
Mingliang Liu 1b8cb0b9c9 Revert "HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran"
This reverts commit a447efa2ab.
2017-01-03 14:45:19 -08:00
Mingliang Liu a447efa2ab HADOOP-13946. Document how HDFS updates timestamps in the FS spec; compare with object stores. Contributed by Steve Loughran
(cherry picked from commit 451efb08fe)
2017-01-03 13:09:29 -08:00
Robert Kanter 2f32a6aea2 YARN-5529. Create new DiskValidator class with metrics (yufeigu via rkanter)
(cherry picked from commit 591fb15944)
2017-01-03 12:14:13 -08:00
Andrew Wang 2b5b62f9cc Revert "HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang."
This reverts commit 80e6640848.
2017-01-03 11:12:53 -08:00
Andrew Wang 80e6640848 HDFS-11156. Add new op GETFILEBLOCKLOCATIONS to WebHDFS REST API. Contributed by Weiwei Yang.
(cherry picked from commit 7fcc73fc0d)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/WebHDFS.md
2017-01-03 09:58:45 -08:00
Brahma Reddy Battula 029b6fbe71 Revert "HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao."
This reverts commit 1bc9b316ba.
2017-01-03 19:26:44 +05:30
Brahma Reddy Battula d6e5e4288c HADOOP-13883. Addendum patch to correct the message and alphabetized with the earlier patch. Contributed by Yiqun Lin.
(cherry picked from commit 6938b67711)
2016-12-31 16:17:15 +05:30
Haohui Mai 1bc9b316ba HDFS-11280. Allow WebHDFS to reuse HTTP connections to NN. Contributed by Zheng Shao. 2016-12-30 22:59:24 -08:00
Daniel Templeton 8cb7aa2b52 YARN-5931. Document timeout interfaces CLI and REST APIs (Contributed by Rohith Sharma K S via Daniel Templeton)
(cherry picked from commit 165d01a73e)
2016-12-30 08:56:03 -08:00
Mingliang Liu ec646b1a9d HADOOP-13942. Build failure due to errors of javadoc build in hadoop-azure. Contributed by Kai Sasaki
(cherry picked from commit c6a5b689db)
2016-12-29 16:24:38 -08:00
Lei Xu db81cc3add HDFS-11267. Avoid redefinition of storageDirs in NNStorage and cleanup its accessors in Storage. (Manoj Govindassamy via lei)
(cherry picked from commit a4f66655ec)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NNStorage.java
2016-12-29 17:06:21 +08:00
Lei Xu f349c7692d HDFS-11251. ConcurrentModificationException during DataNode#refreshVolumes. (Manoj Govindassamy via lei)
(cherry picked from commit e9f1396834)
2016-12-29 15:35:17 +08:00
Daniel Templeton af266c8c85 HDFS-11278. Add missing @Test annotation for TestSafeMode.testSafeModeUtils() (Contributed by Lukas Majercak via Daniel Templeton)
(cherry picked from commit ce3613c965)
2016-12-28 20:11:09 -08:00
Robert Kanter f9b48206dd YARN-4882. Change the log level to DEBUG for recovering completed applications (templedf via rkanter)
(cherry picked from commit f216276d21)
2016-12-28 15:29:06 -08:00
Daniel Templeton 47f0a0e15b HADOOP-13932. Fix indefinite article in comments (Contributed by LiXin Ge via Daniel Templeton) 2016-12-28 07:03:51 -08:00
Sunil G b3231b480d YARN-6024. Capacity Scheduler 'continuous reservation looking' doesn't work when sum of queue's used and reserved resources is equal to max. Contributed by Wangda Tan.
(cherry picked from commit f6715b26b6)
2016-12-28 16:00:52 +05:30
Rohith Sharma K S cb40e3cffa YARN-6001. Improve moveApplicationQueues command line. Contributed by Sunil G.
(cherry picked from commit e297be74ed)
2016-12-28 12:17:38 +05:30
Wangda Tan 42f571728c YARN-5756. Add state-machine implementation for scheduler queues. (Xuan Gong via wangda)
(cherry picked from commit 0840b4329b)
2016-12-27 21:19:10 -08:00
Brahma Reddy Battula 5d46d5d4c6 HDFS-11252. TestFileTruncate#testTruncateWithDataNodesRestartImmediately can fail with BindException. Contributed by Yiqun Lin.
(cherry picked from commit 0ddb8defad)
2016-12-28 10:37:21 +05:30
Robert Kanter 88597991b0 YARN-5257. Fix unreleased resources and null dereferences (yufeigu via rkanter)
(cherry picked from commit 9262797e86)
2016-12-27 14:14:41 -08:00
Robert Kanter 8fbd36c60f YARN-5962. Spelling errors in logging and exceptions for resource manager code (gsohn via rkanter)
(cherry picked from commit 1bbd023275)
2016-12-27 13:35:55 -08:00
Karthik Kambatla 10a154cedd YARN-5969. FairShareComparator: Cache value of getResourceUsage for better performance. (zhangshilong via kasha)
(cherry picked from commit c3973e7080)
2016-12-27 12:30:50 -08:00
Mingliang Liu 74ee21a7b1 HDFS-11270. Document the missing options of NameNode bootstrap command. Contributed by Yiqun Lin
(cherry picked from commit c0e0ef2969)
2016-12-27 11:38:31 -08:00
Akira Ajisaka 74dd2770cc HADOOP-13943. TestCommonConfigurationFields#testCompareXmlAgainstConfigurationClass fails after HADOOP-13863. Contributed by Brahma Reddy Battula.
(cherry picked from commit 0665c5f09a)
2016-12-28 01:41:56 +09:00
Daniel Templeton 28b605dd1a HADOOP-13940. Document the missing envvars commands (Contributed by Yiqun Lin via Daniel Templeton)
(cherry picked from commit d432173737a532b7106682116013b751ba162ff0)
2016-12-27 07:19:37 -08:00
Akira Ajisaka cd331556f6 HDFS-11272. Refine the assert messages in TestFSDirAttrOp. Contributed by Jimmy Xiang.
(cherry picked from commit ea547529cb)
2016-12-26 17:17:14 +09:00
Akira Ajisaka 1b39268233 HDFS-11250. Fix a typo in ReplicaUnderRecovery#setRecoveryID. Contributed by Yiqun Lin.
(cherry picked from commit 8f218ea284)
2016-12-26 16:52:43 +09:00
Akira Ajisaka a779b4ab8f HDFS-11271. Typo in NameNode UI. Contributed by Wei-Chiu Chuang.
(cherry picked from commit 483cd06ad4)
2016-12-26 16:37:52 +09:00
Naganarasimha 4a9f965314 YARN-6026. A couple of spelling errors in the docs. Contributed by Grant Sohn. 2016-12-26 06:50:06 +05:30
Mingliang Liu edac82737a HADOOP-13863. Azure: Add a new SAS key mode for WASB. Contributed by Dushyanth
(cherry picked from commit e92a77099b)
2016-12-22 20:33:51 -08:00
Akira Ajisaka 522bc98026 YARN-4994. Use MiniYARNCluster with try-with-resources in tests. Contributed by Andras Bokor.
(cherry picked from commit ae401539ea)
2016-12-23 04:06:53 +09:00
Akira Ajisaka 16c4dcad85 HDFS-11258. Addendum patch to fix compile issue. Contributed by Jimmy Xiang. 2016-12-23 03:56:12 +09:00
Varun Saxena 3ba589cd1e YARN-5903. Fix race condition in TestResourceManagerAdministrationProtocolPBClientImpl beforeclass setup method (Haibo Chen via Varun Saxena)
(cherry picked from commit 38e66d4d64)
2016-12-22 23:11:18 +05:30
Haohui Mai de926f93c2 HDFS-11258. File mtime change could not save to editlog. Contributed by Jimmy Xiang. 2016-12-21 14:22:09 -08:00
Junping Du cc42dbb703 YARN-4990. Re-direction of a particular log file within in a container in NM UI does not redirect properly. Contributed by Xuan Gong.
(cherry picked from commit 736f54b727)
2016-12-21 14:16:19 -08:00
Akira Ajisaka 897b4a6a77 HDFS-11261. Document missing NameNode metrics. Contributed by Yiqun Lin.
(cherry picked from commit f6e2521eb2)
2016-12-21 14:20:15 +09:00
Xiao Chen 1ab279c311 HDFS-11195. Return error when appending files by webhdfs rest api fails. Contributed by Yuanbo Liu.
(cherry picked from commit 5b7acdd206)
2016-12-20 12:27:40 -08:00
Brahma Reddy Battula 7a92345f16 HDFS-11263. ClassCastException when we use Bzipcodec for Fsimage compression. Contributed by Brahma Reddy Battula.
(cherry picked from commit 1b401f6a73)
2016-12-20 21:02:16 +05:30
Akira Ajisaka a95acbcb6e HDFS-11262. Remove unused variables in FSImage.java. Contributed by Jagadesh Kiran N.
(cherry picked from commit d2026ae9e6)
2016-12-20 14:36:03 +09:00
Sunil G 238863c11b YARN-5650. Render Application Timeout value in web UI. Contributed by Akhil PB. 2016-12-20 11:03:57 +05:30
Naganarasimha e9ce2df1f2 YARN-5524. Yarn live log aggregation does not throw if command line arg is wrong. Contributed by Xuan Gong.
(cherry picked from commit 358341398a)
2016-12-20 06:45:52 +05:30
Wei-Chiu Chuang 0cb99db9d9 HDFS-11160. VolumeScanner reports write-in-progress replicas as corrupt incorrectly. Contributed by Wei-Chiu Chuang and Yongjun Zhang. 2016-12-15 16:35:37 -08:00
Mingliang Liu 012d28a1fa HDFS-11094. Send back HAState along with NamespaceInfo during a versionRequest as an optional parameter. Contributed by Eric Badger 2016-12-15 14:54:40 -08:00
Wei-Chiu Chuang 84ec079911 HADOOP-13508. FsPermission string constructor does not recognize sticky bit. Contributed by Atul Sikaria. 2016-12-15 13:49:02 -08:00
Jason Lowe ee12363f2d HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger
(cherry picked from commit 631f1daee3)
2016-12-15 20:54:42 +00:00
Mingliang Liu 867389247f HADOOP-13831. Correct check for error code to detect Azure Storage Throttling and provide retries. Contributed by Gaurav Kanade
(cherry picked from commit f92913c35b)
2016-12-15 12:38:31 -08:00
Akira Ajisaka eaa50a1087 HDFS-11249. Redundant toString() in DFSConfigKeys.java. Contributed by Jagadesh Kiran N.
(cherry picked from commit 36947f79ba)
2016-12-16 00:34:43 +09:00
Jason Lowe 81be6644ce Revert "HADOOP-13709. Ability to clean up subprocesses spawned by Shell when the process exits. Contributed by Eric Badger"
This reverts commit 0af67aa200.
2016-12-15 14:52:43 +00:00
Xuan 236dbe3485 YARN-5999. AMRMClientAsync will stop if any exceptions thrown on allocate call. Contributed by Jian He 2016-12-14 15:05:42 -08:00
Xiaoyu Yao 85083567be HADOOP-13890. Maintain HTTP/host as SPNEGO SPN support and fix KerberosName parsing. Contributed by Xiaoyu Yao.
(cherry picked from commit f5e0bd30fd)
2016-12-14 13:59:24 -08:00