Commit Graph

8833 Commits

Author SHA1 Message Date
Tsz-Wo Nicholas Sze 1113aca7f8 HDFS-8100. Refactor DFSClient.Conf to a standalone class and separates short-circuit related conf to ShortCircuitConf. 2015-04-10 14:49:32 -07:00
Arun Suresh 3d17c50176 HDFS-7931. DistributedFileSystem should not look for keyProvider in cache if Encryption is disabled (asuresh)
(cherry picked from commit 7660da95cb)
2015-04-10 11:42:18 -07:00
Karthik Kambatla ad99d268e5 YARN-3469. ZKRMStateStore: Avoid setting watches that are not required. (Jun Hong via kasha)
(cherry picked from commit e516706b89)
2015-04-10 11:21:30 -07:00
Jian He d3daf9665c YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev 2015-04-10 10:40:31 -07:00
Akira Ajisaka 3de0bf9a35 MAPREDUCE-6300. Task list sort by task id broken. Contributed by Siqi Li.
(cherry picked from commit 4cec9975c0e2c2fcca090888dc2c5e149c5be1e9)
2015-04-11 01:31:44 +09:00
Junping Du 0891de0712 YARN-1376. NM need to notify the log aggregation status to RM through Node heartbeat. Contributed by Xuan Gong.
(cherry picked from commit 92431c9617)
2015-04-10 08:58:07 -07:00
Akira Ajisaka f603b9ccca MAPREDUCE-6307. Remove property mapreduce.tasktracker.taskmemorymanager.monitoringinterval. Contributed by J.Andreina.
(cherry picked from commit 83979e61a4)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
2015-04-10 20:23:46 +09:00
Harsh J b817f0924d MAPREDUCE-6314. TestPipeApplication fails on trunk. Contributed by Varun Vasudev.
(cherry picked from commit c91b2de68a)
2015-04-10 14:03:37 +05:30
Xuan f5b49160d9 YARN-3293. Track and display capacity scheduler health metrics in web
UI. Contributed by Varun Vasudev

(cherry picked from commit afa5d4715a)
2015-04-09 23:40:02 -07:00
Vinayakumar B 4aba069b37 HDFS-7939. Two fsimage_rollback_* files are created which are not deleted after rollback. (Contributed by J.Andreina)
(cherry picked from commit 987c9e12e1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-04-10 11:27:20 +05:30
Konstantin V Shvachko 0e99da620d HDFS-8081. Split getAdditionalBlock() into two methods. Contributed by Konstantin Shvachko 2015-04-09 22:02:14 -07:00
Haohui Mai e34afb48d4 HDFS-8102. Separate webhdfs retry configuration keys from DFSConfigKeys. Contributed by Haohui Mai. 2015-04-09 14:36:35 -07:00
Vinod Kumar Vavilapalli aec1c5ec7d Adding release 2.7.1 to CHANGES.txt
(cherry picked from commit 623fd46c1e)
2015-04-09 13:56:14 -07:00
Robert Kanter 0fdd5c23c3 MAPREDUCE-6266. Job#getTrackingURL should consistently return a proper URL (rchiang via rkanter)
(cherry picked from commit c4986b2d00)
2015-04-09 13:49:03 -07:00
Arun Suresh c846e84d55 HDFS-8091: ACLStatus and XAttributes should be presented to INodeAttributesProvider before returning to client (asuresh)
(cherry picked from commit 922b7ed21d)
2015-04-09 13:13:23 -07:00
Vinod Kumar Vavilapalli 1ff3fd33ed YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token renewal of applications part of a bigger workflow. Contributed by Daryn Sharp.
(cherry picked from commit 9c5911294e)
2015-04-09 13:10:06 -07:00
Colin Patrick Mccabe 8dac245920 HDFS-8063: Fix intermittent test failures in TestTracing (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 61dc2ea3fe)
2015-04-09 11:42:00 -07:00
Colin Patrick Mccabe ca12088253 HDFS-8099. Change "DFSInputStream has been closed already" message to debug log level (Charles Lamb via Colin P. McCabe)
(cherry picked from commit 30acb7372a)
2015-04-09 11:23:01 -07:00
Haohui Mai f753e2043b HADOOP-11815. HttpServer2 should destroy SignerSecretProvider when it stops. Contributed by Rohith. 2015-04-09 10:58:20 -07:00
Wangda Tan 73d9e4c77b YARN-3466. Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column. (Jason Lowe via wangda)
(cherry picked from commit 1885141e90)
2015-04-09 10:36:10 -07:00
Aaron T. Myers edf2f52d6d HDFS-8101. DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime. Contributed by Sean Busbey.
(cherry picked from commit 3fe61e0bb0)
2015-04-09 09:45:02 -07:00
Kihwal Lee 6d1cb34221 Fix CHANGES.txt for branch-2 2015-04-09 10:05:43 -05:00
Karthik Kambatla 53e0bf5c17 YARN-3465. Use LinkedHashMap to preserve order of resource requests. (Zhihai Xu via kasha)
(cherry picked from commit 6495940eae)
2015-04-09 00:10:23 -07:00
Vinayakumar B 4e099c113b HDFS-8096. DatanodeMetrics#blocksReplicated will get incremented early and even for failed transfers (Contributed by Vinayakumar B)
(cherry picked from commit 9d8952f97f)
2015-04-09 11:59:05 +05:30
Andrew Wang 351fac25a9 HDFS-7979. Initialize block report IDs with a random number.
(cherry picked from commit b1e059089d)
2015-04-08 21:43:57 -07:00
Haohui Mai eafee9a04e HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. Contributed by Li Lu. 2015-04-08 17:56:30 -07:00
Haohui Mai 88ef75f167 HDFS-8089. Move o.a.h.hdfs.web.resources.* to the client jars. Contributed by Haohui Mai. 2015-04-08 16:30:57 -07:00
Andrew Wang 069366e1be HDFS-8025. Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated. Contributed by Ming Ma. 2015-04-08 16:09:28 -07:00
Haohui Mai 6d2eca081d Revert HDFS-7813. 2015-04-08 16:03:20 -07:00
Haohui Mai 35816c438d Revert HDFS-7808. 2015-04-08 16:00:10 -07:00
Andrew Wang 8104d52269 HDFS-7725. Incorrect 'nodes in service' metrics caused all writes to fail. Contributed by Ming Ma. 2015-04-08 15:52:15 -07:00
Andrew Wang 9792500c54 HDFS-8076. Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible. Contributed by Zhe Zhang.
(cherry picked from commit a42bb1cd91)
2015-04-08 15:41:54 -07:00
Hitesh Shah 55b794e7fa YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai.
(cherry picked from commit 265ed1fe80)
2015-04-08 14:14:06 -07:00
Kihwal Lee 7e622076d4 HDFS-8046. Allow better control of getContentSummary. Contributed by Kihwal Lee.
(cherry picked from commit 285b31e75e)
2015-04-08 15:39:25 -05:00
Tsz-Wo Nicholas Sze de7f9a8bcc HDFS-8079. Move CorruptFileBlockIterator to a new hdfs.client.impl package. 2015-04-08 11:51:43 -07:00
Arpit Agarwal f0324738c9 HDFS-8072. Reserved RBW space is not released if client terminates while writing block. (Arpit Agarwal) 2015-04-08 11:38:30 -07:00
Wangda Tan 5f59e621ba YARN-2901 addendum: Fixed findbugs warning caused by previously patch
(cherry picked from commit ba9ee22ca4)
2015-04-08 11:02:54 -07:00
Wangda Tan 97244b143c YARN-3459. Fix failiure of TestLog4jWarningErrorMetricsAppender. (Varun Vasudev via wangda)
(cherry picked from commit 7af086a515)
2015-04-08 10:58:38 -07:00
Tsuyoshi Ozawa ac32fa187c YARN-3457. NPE when NodeManager.serviceInit fails and stopRecoveryStore called. Contributed by Bibin A Chundatt.
(cherry picked from commit dd852f5b8c)
2015-04-08 15:56:33 +09:00
Haohui Mai f9fbde3074 HDFS-8080. Separate JSON related routines used by WebHdfsFileSystem to a package local class. Contributed by Haohui Mai. 2015-04-07 21:30:23 -07:00
Vinayakumar B 3cf7ac181b HDFS-8073. Split BlockPlacementPolicyDefault.chooseTarget(..) so it can be easily overrided. (Contributed by Walter Su)
(cherry picked from commit d505c8acd3)
2015-04-08 09:57:49 +05:30
Tsz-Wo Nicholas Sze eb3ca514fb HDFS-8079. Move dfs.client.retry.* confs from DFSConfigKeys to HdfsClientConfigKeys.Retry. 2015-04-07 19:53:30 -07:00
Yongjun Zhang b76c321e94 HDFS-5215. dfs.datanode.du.reserved is not considered while computing
available space ( Brahma Reddy Battula via Yongjun Zhang)

(cherry picked from commit 66763bb06f)
2015-04-07 19:36:02 -07:00
Arpit Agarwal 8d3657a577 HADOOP-11801. Update BUILDING.txt for Ubuntu. (Contributed by Gabor Liptak) 2015-04-07 18:06:14 -07:00
Robert Kanter b584ce6c0a YARN-3429. Fix incorrect CHANGES.txt
(cherry picked from commit 5b8a3ae366)
2015-04-07 16:16:08 -07:00
cnauroth 6e70611819 HADOOP-11796. Skip TestShellBasedIdMapping.testStaticMapUpdate on Windows. Contributed by Xiaoyu Yao.
(cherry picked from commit bd77a7c4d9)
2015-04-07 14:47:41 -07:00
cnauroth 8921526440 HDFS-8038. PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format. Contributed by Xiaoyu Yao.
(cherry picked from commit 672ed462965ea7da10ce3df48c02e2a3bd13f0ae)
2015-04-07 14:23:29 -07:00
Tsz-Wo Nicholas Sze a4f0eea261 HDFS-8049. Add @InterfaceAudience.Private annotation to hdfs client implementation. Contributed by Takuya Fukudome 2015-04-07 14:01:55 -07:00
Xuan 0522d6970d YARN-3294. Allow dumping of Capacity Scheduler debug logs via web UI for
a fixed time period. Contributed by Varun Vasudev

(cherry picked from commit d27e9241e8)
2015-04-07 09:54:29 -07:00
Karthik Kambatla a12b785edc YARN-2666. Commit 53959e6
(cherry picked from commit 0b5d7d23c4)
2015-04-07 09:08:49 -07:00