8870 Commits

Author SHA1 Message Date
Robert Kanter
0fdd5c23c3 MAPREDUCE-6266. Job#getTrackingURL should consistently return a proper URL (rchiang via rkanter)
(cherry picked from commit c4986b2d00d327f18d0c7e2f8805b69a4e07a19b)
2015-04-09 13:49:03 -07:00
Arun Suresh
c846e84d55 HDFS-8091: ACLStatus and XAttributes should be presented to INodeAttributesProvider before returning to client (asuresh)
(cherry picked from commit 922b7ed21d1f1460263ca42f709bb9f415d189c5)
2015-04-09 13:13:23 -07:00
Vinod Kumar Vavilapalli
1ff3fd33ed YARN-3055. Fixed ResourceManager's DelegationTokenRenewer to not stop token renewal of applications part of a bigger workflow. Contributed by Daryn Sharp.
(cherry picked from commit 9c5911294e0ba71aefe4763731b0e780cde9d0ca)
2015-04-09 13:10:06 -07:00
Colin Patrick Mccabe
8dac245920 HDFS-8063: Fix intermittent test failures in TestTracing (Masatake Iwasaki via Colin P. McCabe)
(cherry picked from commit 61dc2ea3fee4085b19cd2d01de9eacdc4c42e21f)
2015-04-09 11:42:00 -07:00
Colin Patrick Mccabe
ca12088253 HDFS-8099. Change "DFSInputStream has been closed already" message to debug log level (Charles Lamb via Colin P. McCabe)
(cherry picked from commit 30acb7372ab97adf9bc86ead529c96cfe36e2396)
2015-04-09 11:23:01 -07:00
Haohui Mai
f753e2043b HADOOP-11815. HttpServer2 should destroy SignerSecretProvider when it stops. Contributed by Rohith. 2015-04-09 10:58:20 -07:00
Wangda Tan
73d9e4c77b YARN-3466. Fix RM nodes web page to sort by node HTTP-address, #containers and node-label column. (Jason Lowe via wangda)
(cherry picked from commit 1885141e90837252934192040a40047c7adbc1b5)
2015-04-09 10:36:10 -07:00
Aaron T. Myers
edf2f52d6d HDFS-8101. DFSClient use of non-constant DFSConfigKeys pulls in WebHDFS classes at runtime. Contributed by Sean Busbey.
(cherry picked from commit 3fe61e0bb0d025a6acbb754027f73f3084b2f4d1)
2015-04-09 09:45:02 -07:00
Kihwal Lee
6d1cb34221 Fix CHANGES.txt for branch-2 2015-04-09 10:05:43 -05:00
Karthik Kambatla
53e0bf5c17 YARN-3465. Use LinkedHashMap to preserve order of resource requests. (Zhihai Xu via kasha)
(cherry picked from commit 6495940eae09418a939882a8955845f9241a6485)
2015-04-09 00:10:23 -07:00
Vinayakumar B
4e099c113b HDFS-8096. DatanodeMetrics#blocksReplicated will get incremented early and even for failed transfers (Contributed by Vinayakumar B)
(cherry picked from commit 9d8952f97f638ede27e4336b9601507d7bb1de7b)
2015-04-09 11:59:05 +05:30
Andrew Wang
351fac25a9 HDFS-7979. Initialize block report IDs with a random number.
(cherry picked from commit b1e059089d6a5b2b7006d7d384c6df81ed268bd9)
2015-04-08 21:43:57 -07:00
Haohui Mai
eafee9a04e HADOOP-11814. Reformat hadoop-annotations, o.a.h.classification.tools. Contributed by Li Lu. 2015-04-08 17:56:30 -07:00
Haohui Mai
88ef75f167 HDFS-8089. Move o.a.h.hdfs.web.resources.* to the client jars. Contributed by Haohui Mai. 2015-04-08 16:30:57 -07:00
Andrew Wang
069366e1be HDFS-8025. Addendum fix for HDFS-3087 Decomissioning on NN restart can complete without blocks being replicated. Contributed by Ming Ma. 2015-04-08 16:09:28 -07:00
Haohui Mai
6d2eca081d Revert HDFS-7813. 2015-04-08 16:03:20 -07:00
Haohui Mai
35816c438d Revert HDFS-7808. 2015-04-08 16:00:10 -07:00
Andrew Wang
8104d52269 HDFS-7725. Incorrect 'nodes in service' metrics caused all writes to fail. Contributed by Ming Ma. 2015-04-08 15:52:15 -07:00
Andrew Wang
9792500c54 HDFS-8076. Code cleanup for DFSInputStream: use offset instead of LocatedBlock when possible. Contributed by Zhe Zhang.
(cherry picked from commit a42bb1cd915abe5dc33eda3c01e8c74c64f35748)
2015-04-08 15:41:54 -07:00
Hitesh Shah
55b794e7fa YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai.
(cherry picked from commit 265ed1fe804743601a8b62cabc1e4dc2ec8e502f)
2015-04-08 14:14:06 -07:00
Kihwal Lee
7e622076d4 HDFS-8046. Allow better control of getContentSummary. Contributed by Kihwal Lee.
(cherry picked from commit 285b31e75e51ec8e3a796c2cb0208739368ca9b8)
2015-04-08 15:39:25 -05:00
Tsz-Wo Nicholas Sze
de7f9a8bcc HDFS-8079. Move CorruptFileBlockIterator to a new hdfs.client.impl package. 2015-04-08 11:51:43 -07:00
Arpit Agarwal
f0324738c9 HDFS-8072. Reserved RBW space is not released if client terminates while writing block. (Arpit Agarwal) 2015-04-08 11:38:30 -07:00
Wangda Tan
5f59e621ba YARN-2901 addendum: Fixed findbugs warning caused by previously patch
(cherry picked from commit ba9ee22ca4ed2c5ff447b66b2e2dfe25f6880fe0)
2015-04-08 11:02:54 -07:00
Wangda Tan
97244b143c YARN-3459. Fix failiure of TestLog4jWarningErrorMetricsAppender. (Varun Vasudev via wangda)
(cherry picked from commit 7af086a515d573dc90ea4deec7f4e3f23622e0e8)
2015-04-08 10:58:38 -07:00
Tsuyoshi Ozawa
ac32fa187c YARN-3457. NPE when NodeManager.serviceInit fails and stopRecoveryStore called. Contributed by Bibin A Chundatt.
(cherry picked from commit dd852f5b8c8fe9e52d15987605f36b5b60f02701)
2015-04-08 15:56:33 +09:00
Haohui Mai
f9fbde3074 HDFS-8080. Separate JSON related routines used by WebHdfsFileSystem to a package local class. Contributed by Haohui Mai. 2015-04-07 21:30:23 -07:00
Vinayakumar B
3cf7ac181b HDFS-8073. Split BlockPlacementPolicyDefault.chooseTarget(..) so it can be easily overrided. (Contributed by Walter Su)
(cherry picked from commit d505c8acd30d6f40d0632fe9c93c886a4499a9fc)
2015-04-08 09:57:49 +05:30
Tsz-Wo Nicholas Sze
eb3ca514fb HDFS-8079. Move dfs.client.retry.* confs from DFSConfigKeys to HdfsClientConfigKeys.Retry. 2015-04-07 19:53:30 -07:00
Yongjun Zhang
b76c321e94 HDFS-5215. dfs.datanode.du.reserved is not considered while computing
available space ( Brahma Reddy Battula via Yongjun Zhang)

(cherry picked from commit 66763bb06f107f0e072c773a5feb25903c688ddc)
2015-04-07 19:36:02 -07:00
Arpit Agarwal
8d3657a577 HADOOP-11801. Update BUILDING.txt for Ubuntu. (Contributed by Gabor Liptak) 2015-04-07 18:06:14 -07:00
Robert Kanter
b584ce6c0a YARN-3429. Fix incorrect CHANGES.txt
(cherry picked from commit 5b8a3ae366294aec492f69f1a429aa7fce5d13be)
2015-04-07 16:16:08 -07:00
cnauroth
6e70611819 HADOOP-11796. Skip TestShellBasedIdMapping.testStaticMapUpdate on Windows. Contributed by Xiaoyu Yao.
(cherry picked from commit bd77a7c4d94fe8a74b36deb50e19396c98b8908e)
2015-04-07 14:47:41 -07:00
cnauroth
8921526440 HDFS-8038. PBImageDelimitedTextWriter#getEntry output HDFS path in platform-specific format. Contributed by Xiaoyu Yao.
(cherry picked from commit 672ed462965ea7da10ce3df48c02e2a3bd13f0ae)
2015-04-07 14:23:29 -07:00
Tsz-Wo Nicholas Sze
a4f0eea261 HDFS-8049. Add @InterfaceAudience.Private annotation to hdfs client implementation. Contributed by Takuya Fukudome 2015-04-07 14:01:55 -07:00
Xuan
0522d6970d YARN-3294. Allow dumping of Capacity Scheduler debug logs via web UI for
a fixed time period. Contributed by Varun Vasudev

(cherry picked from commit d27e9241e8676a0edb2d35453cac5f9495fcd605)
2015-04-07 09:54:29 -07:00
Karthik Kambatla
a12b785edc YARN-2666. Commit 53959e6
(cherry picked from commit 0b5d7d23c469a82cc28a0ff6a4d27e1b3be91394)
2015-04-07 09:08:49 -07:00
Xuan
7941cc554b YARN-3110. Few issues in ApplicationHistory web ui. Contributed by Naganarasimha G R
(cherry picked from commit 19a4feaf6fcf42ebbfe98b8a7153ade96d37fb14)
2015-04-07 08:24:09 -07:00
Owen O'Malley
c16af2f6f8 HADOOP-11717. Support JWT tokens for web single sign on to the Hadoop
servers. (Larry McCay via omalley)
2015-04-07 08:17:10 -07:00
Konstantin V Shvachko
81b522790b HDFS-8071. Redundant checkFileProgress() in PART II of getAdditionalBlock(). Contributed by Konstantin Shvachko. 2015-04-06 22:23:33 -07:00
Zhijie Shen
735e4f15ab Move YARN-3273 from 2.8 to 2.7.
(cherry picked from commit 5e9f4099de4b949c838a6224442f335c67d80936)
2015-04-06 14:15:23 -07:00
Robert Kanter
354d2c75cf YARN-2429. TestAMRMTokens.testTokenExpiry fails Intermittently with error message:Invalid AMRMToken (zxu via rkanter)
(cherry picked from commit 99b08a748e7b00a58b63330b353902a6da6aae27)
2015-04-06 14:11:50 -07:00
Colin Patrick Mccabe
a827089905 HDFS-7999. FsDatasetImpl#createTemporary sometimes holds the FSDatasetImpl lock for a very long time (sinago via cmccabe)
(cherry picked from commit 28bebc81db8bb6d1bc2574de7564fe4c595cfe09)
2015-04-06 09:10:15 -07:00
Tsuyoshi Ozawa
d2b2d76cce TestFairScheduler.testContinuousScheduling fails Intermittently. Contributed by Zhihai Xu.
(cherry picked from commit 53959e69f7ef4442324627fbfb159012968a2092)
2015-04-06 20:19:47 +09:00
Xuan
1eb6d74967 YARN-3435. AM container to be allocated Appattempt AM container shown as
null. Contributed by Bibin A Chundatt

(cherry picked from commit 96d72118f5c81aa4e0dca0dc0241fbf1a3fff4d2)
2015-04-05 00:43:22 -07:00
Vinod Kumar Vavilapalli
00854d2c2f HADOOP-11776. Fixed the broken JDiff support in Hadoop 2. Contributed by Li Lu.
(cherry picked from commit 4b3948ea365db07df7a9369a271009fafd1ba8f5)
2015-04-04 13:52:51 -07:00
Vinod Kumar Vavilapalli
4eec6e09d0 HADOOP-11377. Added Null.java without which jdiff completely flops. Contributed by Tsuyoshi Ozawa.
(cherry picked from commit 5370e7128b4b78dabff79986a92151f1de39eeed)
2015-04-04 13:48:14 -07:00
Colin Patrick Mccabe
b26ba22a90 HDFS-8051. FsVolumeList#addVolume should release volume reference if not put it into BlockScanner. (Lei (Eddy) Xu via Colin P. McCabe)
(cherry picked from commit ef591b1d6a08f08358b19763a874de6010227307)
2015-04-03 16:56:25 -07:00
Colin Patrick Mccabe
0c5069c432 HDFS-7996. After swapping a volume, BlockReceiver reports ReplicaNotFoundException (Lei (Eddy) Xu via Colin P. McCabe)
(cherry picked from commit 023133cef9a7ca05364cefbcead57c921589eda7)
2015-04-03 14:26:45 -07:00
Colin Patrick Mccabe
386b90a700 HADOOP-11785. Reduce the number of listStatus operation in distcp buildListing (Zoran Dimitrijevic via Colin P. McCabe)
(cherry picked from commit 932730df7d62077f7356464ad27f69469965d77a)
2015-04-03 14:08:53 -07:00