Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,979 Commits 326 Branches 371 Tags
Commit Graph

10979 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Colin Patrick Mccabe
86760c0f52 HADOOP-12766. The default value of "hadoop.workaround.non.threadsafe.getpwuid" is different between core-default.xml and NativeIO.java (Akira AJISAKA via cmccabe) 
(cherry picked from commit 9086dd58c3fc391ffdc017a913e56d1801040c7a)
 2016-02-05 10:57:47 -08:00
Xiaoyu Yao
e0a356fee3 HADOOP-12771. Fix typo in JvmPauseMonitor#getNumGcWarnThreadholdExceeded. Contributed by Xiaobing Zhou. 
(cherry picked from commit 5d00067ca7f1460bbda1330e7329205a7b1ce019)
 2016-02-05 10:38:02 -08:00
Tsz-Wo Nicholas Sze
117397b89f HDFS-9726. Refactor IBR code to a new class. 2016-02-05 23:20:16 +08:00
Haohui Mai
e62ca14856 HDFS-9724. Degraded performance in WebHDFS listing as it does not reuse ObjectMapper. Contributed by Akira Ajisaka. 2016-02-04 11:35:34 -08:00
Kihwal Lee
e26c58fb4e HDFS-9730. Storage ID update does not happen when there is a layout change. Contributed by Tsz Wo Nicholas Sze. 
(cherry picked from commit 496f33de0ce80dc455cfd51f19612da6f9b914f9)
 2016-02-04 13:21:30 -06:00
Varun Vasudev
be04535f1a YARN-4669. Fix logging statements in resource manager's Application class. Contributed by Sidharta Seethana. 
(cherry picked from commit a4a30c789146c4e824fcc6ebcf10405711120eaa)
 2016-02-04 13:51:08 +05:30
Vinayakumar B
6ee66be2fa HDFS-9629. Update the footer of Web UI to show year 2016 (Contributed by Xiao Chen and Vinayakumar B) 
(cherry picked from commit ddcd6954d03d3caadc8b69f7b886a3a17c3c9d0c)
 2016-02-04 13:38:26 +05:30
Varun Vasudev
99966b1912 YARN-4307. Display blacklisted nodes for AM container in the RM web UI. Contributed by Naganarasimha G R. 
(cherry picked from commit 308d63f382e1992ea2b8ccf3130edaaa751c644d)
 2016-02-04 13:33:38 +05:30
Xuan
dfad608b22 YARN-4662. Document some newly added metrics. Contributed by Jian He 
(cherry picked from commit 63c63e298cf9ff252532297deedde15e77323809)
 2016-02-03 20:06:25 -08:00
Konstantin V Shvachko
4a0550537c HDFS-9503. Use generic option -fs for NNThroughputBenchmark instead of -namenode. Contributed by Mingliang Liu. 2016-02-03 14:51:41 -08:00
Konstantin V Shvachko
6d1f9a6b4c Move HDFS-9601 to branch-2.8.0 in CHANGES.txt. (shv) 2016-02-03 14:36:25 -08:00
Jing Zhao
459c31de4a HDFS-9748. Avoid duplication in pendingReplications when addExpectedReplicasToPending is called twice. Contributed by Walter Su. 
(cherry picked from commit 7badf156049b78cabf8537fff9846a0f9924a090)
 2016-02-03 13:32:19 -08:00
Jason Lowe
b12f16ab73 YARN-4594. container-executor fails to remove directory tree when chmod required. Contributed by Colin Patrick McCabe 
(cherry picked from commit fa328e2d39eda1c479389b99a5c121e640a1e0ad)
 2016-02-03 17:22:12 +00:00
Sangjin Lee
b0ab6df079 HADOOP-12761. incremental maven build is not really incremental (sjlee) 
(cherry picked from commit 4dc0a3949386ce2961356143a5a843dd537829dc)
 2016-02-03 09:00:41 -08:00
Varun Vasudev
e211ab777e YARN-4625. Make ApplicationSubmissionContext and ApplicationSubmissionContextInfo more consistent. Contributed by Xuan Gong. 
(cherry picked from commit 1adb64e09bd453f97e83d31b1587079e30b4b274)
 2016-02-03 16:28:31 +05:30
Vinayakumar B
6941e2ccbf HDFS-9740. Use a reasonable limit in DFSTestUtil.waitForMetric() (Contributed by Chang Li) 
(cherry picked from commit eb2fb943fd97c191fd7c4f5333087a28ee5c87d8)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java
 2016-02-03 11:21:08 +05:30
Vinayakumar B
e8a9a69a27 HDFS-9739. DatanodeStorage.isValidStorageId() is broken (Contributed by Mingliang Liu) 
(cherry picked from commit d6b1acb940180befeb4c855d0e4a339dbc035e7d)
 2016-02-03 10:33:55 +05:30
Vinayakumar B
8577c0b6a2 HDFS-9715. Check storage ID uniqueness on datanode startup (Contributed by Lei (Eddy) Xu) 
(cherry picked from commit 04375756a5ed6e907ee7548469c2c508aebbafb7)
 2016-02-03 07:35:47 +05:30
Junping Du
3583c77ee8 Adding release 2.6.5 to CHANGES.txt 2016-02-02 18:09:17 -08:00
Robert Kanter
358c49d830 MAPREDUCE-6620. Jobs that did not start are shown as starting in 1969 in the JHS web UI (haibochen via rkanter) 
(cherry picked from commit ccbba4a4deb8ade54a04137c993526e461bcb46e)
 2016-02-02 15:21:51 -08:00
Andrew Wang
b4ad58796b HADOOP-12755. Fix typo in defaultFS warning message. 
(cherry picked from commit 8171874dd198a6d10f48211f311595b222e6b930)
 2016-02-02 11:56:47 -08:00
Jason Lowe
4ee0977687 MAPREDUCE-6621. Memory Leak in JobClient#submitJobInternal(). Contributed by Xuan Gong 
(cherry picked from commit 43e669b22d9ac0b81ab8cc397c5d6d92bac986c6)
 2016-02-02 19:31:33 +00:00
Colin Patrick Mccabe
60d3a3c30b HDFS-9669. TcpPeerServer should respect ipc.server.listen.queue.size (Elliot Clark via cmccabe) 
(cherry picked from commit 2da03b48eba53d4dec2a77209ad9835d808171d1)
 2016-02-02 11:04:33 -08:00
Lei Xu
2f1d1c67f0 HDFS-9721. Allow Delimited PB OIV tool to run upon fsimage that contains INodeReference. (Xiao Chen via lei) 
(cherry picked from commit 9d494f0c0eaa05417f3a3e88487d878d1731da36)
 2016-02-02 10:42:24 -08:00
Vinayakumar B
80dd039b6e HDFS-9718. HAUtil#getConfForOtherNodes should unset independent generic keys before initialize (Contributed by DENG FEI) 
(cherry picked from commit 4d7055e0c8d1936d6c87cec14dbbfdff77b837f3)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/HAUtil.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/ha/TestHAConfiguration.java
 2016-02-02 12:56:31 +05:30
Devaraj K
43131af1e2 YARN-4100. Add Documentation for Distributed and Delegated-Centralized 
Node Labels feature. Contributed by Naganarasimha G R.

(cherry picked from commit db144eb1c51c1f37bdd1e0c18e9a5b0969c82e33)
 2016-02-02 12:07:49 +05:30
Varun Vasudev
bbda446889 YARN-4649. Add additional logging to some NM state store operations. Contributed by Sidharta Seethana 
(cherry picked from commit 1cd55e0c171f7c4dec6f843931285557d59cd5ea)
 2016-02-02 09:26:22 +05:30
Wangda Tan
9591363ad8 YARN-4340. Add list API to reservation system. (Sean Po via wangda) 
(cherry picked from commit 9875325d5c63f343809907d06bf48a298035a611)
 2016-02-02 10:19:19 +08:00
Jason Lowe
36aae8050e YARN-3102. Decommisioned Nodes not listed in Web UI. Contributed by Kuhu Shukla 
(cherry picked from commit ed55950164a66e08fa34e30dba1030c5a986d1f1)
 2016-02-01 23:16:18 +00:00
Yongjun Zhang
fc8d9cc758 HDFS-9406. FSImage may get corrupted after deleting snapshot. (Contributed by Jing Zhao, Stanislav Antic, Vinayakumar B, Yongjun Zhang) 
(cherry picked from commit 34ab50ea92370cc7440a8f7649286b148c2fde65)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestINodeFile.java
 2016-02-01 14:09:52 -08:00
Lei Xu
d2f8e6c269 HDFS-9701. DN may deadlock when hot-swapping under load. (Xiao Chen via lei) 
(cherry picked from commit 12a4ebb4471f78b642e12c2ec0784c20f62cca3c)
 2016-02-01 12:56:00 -08:00
Xiaoyu Yao
7cc3b1c7a3 HDFS-9210. Fix some misuse of %n in VolumeScanner#printStats. Contributed by Xiaoyu Yao. 
(cherry picked from commit b11008d54d8aa3eb9c7c10c3a0734d95b9ef41e9)
 2016-02-01 11:57:11 -08:00
Jason Lowe
f5f6652137 MAPREDUCE-6618. YarnClientProtocolProvider leaking the YarnClient thread. Contributed by Xuan Gong 
(cherry picked from commit 59a212b6e1265adfa9b55c71b65a22157dfccf77)
 2016-02-01 16:06:42 +00:00
Steve Loughran
7786e97df2 HDFS-9708. FSNamesystem.initAuditLoggers() doesn't trim classnames (Mingliang Liu via stevel) 2016-02-01 16:01:32 +00:00
Vinayakumar B
71374cca9d HDFS-9566. Remove expensive 'BlocksMap#getStorages(Block b, final DatanodeStorage.State state)' method (Contributed by Daryn Sharp) 
(cherry picked from commit e418bd1fb0568ce7ae22f588fea2dd9c95567383)

 Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java
 2016-02-01 13:32:00 +05:30
Rohith Sharma K S
676f215595 YARN-4615. Fix random test failure in TestAbstractYarnScheduler#testResourceRequestRecoveryToTheRightAppAttempt. (Sunil G via rohithsharmaks) 
(cherry picked from commit 2673cbaf556eb4d0e44519cdbb8c6f0f02412a21)
 2016-02-01 10:45:05 +05:30
Jason Lowe
016c685135 YARN-4428. Redirect RM page to AHS page when AHS turned on and RM page is not available. Contributed by Chang Li 
(cherry picked from commit 772ea7b41b06beaa1f4ac4fa86eac8d6e6c8cd36)
 2016-01-29 21:54:56 +00:00
Jian He
885c76d85f YARN-4617. LeafQueue#pendingOrderingPolicy should always use fixed ordering policy instead of using same as active applications ordering policy. Contributed by Rohith Sharma K S 2016-01-29 12:22:44 -08:00
Yongjun Zhang
2fb711bde9 HDFS-9638. Improve DistCp Help and documentation. (Wei-Chiu Chuang via Yongjun Zhang) 
(cherry picked from commit eddd823cd6246ddc66218eb01009c44b0236eaaa)
 2016-01-29 12:13:03 -08:00
Karthik Kambatla
9d1371d390 YARN-4647. Make RegisterNodeManagerRequestPBImpl thread-safe. (kasha) 
(cherry picked from commit c9a09d6926b258e205a4ff7998ce5a86bf5dbe3b)
 2016-01-29 08:19:34 -08:00
Devaraj K
123269c07f YARN-4411. RMAppAttemptImpl#createApplicationAttemptReport throws 
IllegalArgumentException. Contributed by Bibin A Chundatt and yarntime.

(cherry picked from commit a277bdc9edc66bef419fcd063b832073e512f234)
 2016-01-29 13:52:47 +05:30
Akira Ajisaka
6ce9b1240e MAPREDUCE-6616. Fail to create jobhistory file if there are some multibyte characters in the job name. Contributed by Kousuke Saruta. 
(cherry picked from commit d314a3f99d5d03c62a3b8fb8883886440ab7d1db)
 2016-01-29 16:20:37 +09:00
Yongjun Zhang
a24898fd49 HDFS-9706. Log more details in debug logs in BlockReceiver's constructor. (Xiao Chen via Yongjun Zhang) 
(cherry picked from commit 8ee060311c89b7faa71dd039481a97ba15e2413d)
 2016-01-28 23:13:41 -08:00
Rohith Sharma K S
b8d5df06f2 YARN-4543. Fix random test failure in TestNodeStatusUpdater.testStopReentrant. (Akihiro Suda via rohithsharmaks) 
(cherry picked from commit ac686668031ee9837deed3f3566f09f33c437870)
 2016-01-29 12:30:53 +05:30
Rohith Sharma K S
0466743afb YARN-4219. addendum patch to fix javadoc errors 
(cherry picked from commit 09d831c95ba18e2892cddd749f6e06f112dda7f5)
 2016-01-29 11:53:06 +05:30
Colin Patrick Mccabe
dc65479fc0 HDFS-7764. DirectoryScanner shouldn't abort the scan if one directory had an error (Rakesh R via cmccabe) 
(cherry picked from commit f67149ab08bb49381def6c535ab4c4610e0a4221)
 2016-01-28 20:12:18 -08:00
Karthik Kambatla
363a8212ec HADOOP-12702. Add an HDFS metrics sink. (Daniel Templeton via kasha) 
(cherry picked from commit ee005e010cff3f97a5daa8000ac2cd151e2631ca)
 2016-01-28 17:45:50 -08:00
Jian He
36f0e73882 YARN-4519. Potential deadlock of CapacityScheduler between decrease container and assign containers. Contributed by Meng Ding 2016-01-28 14:52:00 -08:00
cnauroth
bd01fdb64d MAPREDUCE-6563. Streaming documentation contains a stray % character. Contributed by Chris Nauroth. 
(cherry picked from commit 41da9a07738c6d019e2467f139750b7e2f50a914)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
 2016-01-28 14:46:42 -08:00
Xuan
2f00d8d3a7 YARN-4219. New levelDB cache storage for timeline v1.5. Contributed by 
Li Lu

(cherry picked from commit 9fab22b36673e7f1a0bb629d2c07966ac2482e99)
 2016-01-28 14:36:58 -08:00