7691 Commits

Author SHA1 Message Date
Jian He
7f97189bcf YARN-2865. Fixed RM to always create a new RMContext when transtions from StandBy to Active. Contributed by Rohith Sharmaks
(cherry picked from commit 9cb8b75ba57f18639492bfa3b7e7c11c00bb3d3b)

(cherry picked from commit db31ef7e7f55436bbf88c6d93e2273c4463ca9f0)
(cherry picked from commit e669974ae94c03914c9181a4481b4879fd4acc0d)
2015-08-27 18:56:22 -07:00
Andrew Wang
0898c21e24 HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang)
(cherry picked from commit 406c09ad1150c4971c2b7675fcb0263d40517fbf)
(cherry picked from commit 2e15754a92c6589308ccbbb646166353cc2f2456)
(cherry picked from commit 014d07de2e9b39be4b6793f0e09fcf8548570ad5)
2015-08-27 18:48:17 -07:00
Jason Lowe
f307b426f3 YARN-2414. RM web UI: app page will crash if app is failed before any attempt has been created. Contributed by Wangda Tan
(cherry picked from commit 81c9d17af84ed87b9ded7057cb726a3855ddd32d)

(cherry picked from commit 242fd0e39ad1c5d51719cd0f6c197166066e3288)
(cherry picked from commit a9d5acd898b34e1050a78f2d70ed62fdb82948a6)
2015-08-27 18:36:50 -07:00
Jason Lowe
f83d898944 YARN-2816. NM fail to start with NPE during container recovery. Contributed by Zhihai Xu
(cherry picked from commit 49c38898b0be64fc686d039ed2fb2dea1378df02)

(cherry picked from commit ad140d1fc831735fb9335e27b38d2fc040847af1)
(cherry picked from commit 85b23c323c80c5303bd0b7bdb066258792ca67d8)
2015-08-27 18:32:59 -07:00
Jian He
81ba30211e YARN-2856. Fixed RMAppImpl to handle ATTEMPT_KILLED event at ACCEPTED state on app recovery. Contributed by Rohith Sharmaks
(cherry picked from commit d005404ef7211fe96ce1801ed267a249568540fd)

(cherry picked from commit beb184ac580b0d89351a3f3a7201da34a26db1c1)
(cherry picked from commit 325bb33988743d60cb333002f9da60314241632e)
2015-08-27 18:29:39 -07:00
Vinayakumar B
d6666e8d26 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu.
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit d6050f06a3b7e049541b1cb4597c388abf00a5be)
2015-08-27 18:18:32 -07:00
Haohui Mai
7405de4970 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu.
(cherry picked from commit 9e63cb4492896ffb78c84e27f263a61ca12148c8)
(cherry picked from commit 7adb6f9501e8efaa712fb70fe5a97e233622e3e1)
2015-08-27 18:18:25 -07:00
Tao Luo
6d2f80107f HDFS-7263. Snapshot read can reveal future bytes for appended files. Contributed by Tao Luo.
(cherry picked from commit 8bfef590295372a48bd447b1462048008810ee17)

(cherry picked from commit 3827a1acdbc4f9fec3179dcafa614734b5fa31bc)
2015-08-27 17:53:06 -07:00
Colin Patrick Mccabe
d3a7769bff HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlock (yzhang via cmccabe)
(cherry picked from commit ac9ab037e9a9b03e4fa9bd471d3ab9940beb53fb)

(cherry picked from commit 842a54a5f66e76eb79321b66cc3b8820fe66c5cd)
(cherry picked from commit 1aa9e34c5106c496ffd390f6b2c822d387fb1908)
2015-08-27 17:47:39 -07:00
Ming Ma
dda8e0e328 HDFS-7314. When the DFSClient lease cannot be renewed, abort open-for-write files rather than the entire DFSClient. (mingma)
(cherry picked from commit fbd88f1062f3c4b208724d208e3f501eb196dfab)
(cherry picked from commit 516bbf1c20547dc513126df0d9f0934bb65c10c7)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java
	hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSClientRetries.java

(cherry picked from commit fb1bf424bdad20fff7ab390ce75c4bec558e7e6d)
2015-08-27 17:38:06 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
4239513ec0 Adding release 2.6.1 to CHANGES.txt
(cherry picked from commit 7c796fd12ca5092d74e6cc7044f28496f9884983)
2015-08-11 13:23:27 -07:00
Arpit Agarwal
aa2303088f HDFS-8486. DN startup may cause severe data loss. (Contributed by Daryn Sharp) 2015-08-06 15:17:45 -07:00
Akira Ajisaka
0daf9dd552 Revert "Merge r1588258 from trunk, HDFS-6153. Document "fileId" and "childrenNum" fields in the FileStatus Json schema"
This reverts commit 641cbc0febe546e350a5fd4f37e717f2b8e52d6f.
2015-04-16 16:40:31 -05:00
Wangda Tan
881084fe5c YARN-3251. Fixed a deadlock in CapacityScheduler when computing absoluteMaxAvailableCapacity in LeafQueue (Craig Welch via wangda) 2015-02-26 17:05:25 -08:00
Tsuyoshi Ozawa
5b3d9bf636 MAPREDUCE-6237. Multiple mappers with DBInputFormat don't work because of reusing conections. Contributed by Kannan Rajah.
(cherry picked from commit 241336ca2b7cf97d7e0bd84dbe0542b72f304dc9)

Conflicts:
	hadoop-mapreduce-project/CHANGES.txt
2015-02-10 03:54:54 +09:00
Arpit Agarwal
ef212fbe7e HDFS-7733. NFS: readdir/readdirplus return null directory attribute on failure. (Contributed by Arpit Agarwal) 2015-02-04 16:26:00 -08:00
Colin Patrick Mccabe
ebb515f5e7 HADOOP-11466. FastByteComparisons: do not use UNSAFE_COMPARER on the SPARC architecture because it is slower there (Suman Somasundar via Colin P. McCabe)
(cherry picked from commit ee7d22e90ce67de3e7ee92f309c048a1d4be0bbe)
(cherry picked from commit 2c69f8cf81aed731762524e821088fd779210601)
2015-01-26 11:19:24 -08:00
Tsz-Wo Nicholas Sze
4f5d330623 HDFS-3443. Fix NPE when namenode transition to active during startup by adding checkNNStartup() in NameNodeRpcServer. Contributed by Vinayakumar B
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java
2015-01-21 11:54:26 -08:00
Tsuyoshi Ozawa
07b3329e3f Revert "CHANGES.txt: add YARN-2977"
This reverts commit 3419091631777ec04dd1a9e2bf24adab2496c5ce.
2014-12-21 12:47:30 +09:00
Tsuyoshi Ozawa
ca121a78fd Revert "YARN-2977. Fixed intermittent TestNMClient failure. (Contributed by Junping Du)"
This reverts commit d79f63120e16cb03f3f85b5d79a84202881a95a5.
2014-12-21 12:47:28 +09:00
Tsuyoshi Ozawa
3419091631 CHANGES.txt: add YARN-2977
(cherry picked from commit 76b0370a27c482caff9498e15ef889d37f413ce7)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-12-20 23:11:04 +09:00
Tsuyoshi Ozawa
d79f63120e YARN-2977. Fixed intermittent TestNMClient failure. (Contributed by Junping Du)
(cherry picked from commit cf7fe583d14ebb16fc1b6e29dc2afbf67d24b9d1)
2014-12-20 23:09:58 +09:00
Colin Patrick Mccabe
51d49ffffd HDFS-7443. Datanode upgrade to BLOCKID_BASED_LAYOUT fails if duplicate block files are present in the same volume (cmccabe)
(cherry picked from commit 8fa265a290792ff42635ff9b42416c634f88bdf3)
(cherry picked from commit bcaf15e2fa94db929b8cd11ed7c07085161bf950)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/DataStorage.java
2014-12-19 13:25:33 -08:00
arp
91042c950f HDFS-7503. Namenode restart after large deletions can cause slow processReport (Arpit Agarwal) 2014-12-10 23:38:55 -08:00
Colin Patrick Mccabe
d93bfbace4 HDFS-7489. Incorrect locking in FsVolumeList#checkDirs can hang datanodes (Noah Lorang via Colin P. McCabe)
(cherry picked from commit d8352b9b2b99aa46679c5880a724ba3f0ceb41ff)
(cherry picked from commit a037d6030b5ae9422fdb265f5e4880d515be9e37)
2014-12-09 10:59:49 -08:00
Colin Patrick Mccabe
575d7bd5b0 HDFS-4882. Prevent the Namenode's LeaseManager from looping forever in checkLeases (Ravi Prakash via Colin P. McCabe)
(cherry picked from commit daacbc18d739d030822df0b75205eeb067f89850)
2014-11-24 11:42:46 -08:00
cnauroth
2379932968 HDFS-7425. NameNode block deletion logging uses incorrect appender. Contributed by Chris Nauroth.
(cherry picked from commit b8c094b0754099f13d668081b4afcf0644e325c3)
(cherry picked from commit 8d8eb8dcec94e92d94eedef883cdece8ba333087)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-11-21 16:58:06 -08:00
Karthik Kambatla
5913c5143b Update release date for 2.5.2
(cherry picked from commit 1e9a3f42ff49be788ac99e5f06a7984d1d0638cc)
2014-11-21 14:35:06 -08:00
Jonathan Eagles
a9b76813a2 YARN-2375. Allow enabling/disabling timeline server per framework. (Mit Desai via jeagles)
(cherry picked from commit c298a9a845f89317eb9efad332e6657c56736a4d)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-20 23:54:59 -06:00
Karthik Kambatla
2740d24ad3 HADOOP-11307. create-release script should run git clean first (kasha)
(cherry picked from commit 4fb96dbe3bbfd3ae88b41c816e15acee04518851)
2014-11-14 15:38:23 -08:00
Arun C. Murthy
98a4538cf4 Preparing to release hadoop-2.6.0-rc1.
(cherry picked from commit 9ff7315cbe9804bebcd1ec093fac7828a72ddf59)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
	hadoop-mapreduce-project/CHANGES.txt
	hadoop-yarn-project/CHANGES.txt
2014-11-13 13:05:50 -08:00
cnauroth
ed2a4db6d4 HDFS-7385. ThreadLocal used in FSEditLog class causes FSImage permission mess up. Contributed by jiangyu.
(cherry picked from commit b0a41de68c5b08f534ca231293de053c0b0cbd5d)
(cherry picked from commit 4e9001530f7bc414b43723858cf7984f707b30e0)
2014-11-13 12:37:48 -08:00
Arun C. Murthy
4e9b46da11 YARN-1964. Adding changelog back in. 2014-11-13 11:39:35 -08:00
Arun C. Murthy
32032ace21 YARN-2853. Merging to branch-2.6 for hadoop-2.6.0-rc1.
(cherry picked from commit d648e60ebab7f1942dba92e9cd2cb62b8d70419b)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-13 10:40:33 -08:00
Vinod Kumar Vavilapalli
56020955fd YARN-2853. Fixed a bug in ResourceManager causing apps to hang when the user kill request races with ApplicationMaster finish. Contributed by Jian He.
(cherry picked from commit 3651fe1b089851b38be351c00a9899817166bf3e)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-13 10:40:09 -08:00
Arun C. Murthy
f8892660a8 YARN-2635. Merging to branch-2.6 for hadoop-2.6.0-rc1.
(cherry picked from commit 81dc0ac6dcf2f34ad607da815ea0144f178691a9)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-13 10:36:58 -08:00
Karthik Kambatla
b579c3d405 YARN-2635. TestRM, TestRMRestart, TestClientToAMTokens should run with both CS and FS. (Wei Yan and kasha via kasha)
(cherry picked from commit 80d11eb68e60f88e16d7d41edecbddfc935a6b10)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/security/TestClientToAMTokens.java
2014-11-13 10:36:13 -08:00
Jason Lowe
685790e027 YARN-2846. Incorrect persist exit code for running containers in reacquireContainer() that interrupted by NodeManager restart. Contributed by Junping Du
(cherry picked from commit 33ea5ae92b9dd3abace104903d9a94d17dd75af5)
2014-11-13 16:12:30 +00:00
Jason Lowe
9b383f6813 MAPREDUCE-6156. Fetcher - connect() doesn't handle connection refused correctly. Contributed by Junping Du
(cherry picked from commit 177e8090f5809beb3ebcb656cd0affbb3f487de8)
2014-11-13 15:44:00 +00:00
Haohui Mai
59b2a74ea9 Fix CHANGES.txt to keep it consistent with trunk. 2014-11-12 20:13:38 -08:00
Arun C. Murthy
797e62defa HDFS-7391. Renable SSLv2Hello in HttpFS. Contributed by Robert Kanter.
Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-11-12 19:00:50 -08:00
Karthik Kambatla
e02f5674b8 HADOOP-11217. (Addendum to allow SSLv2Hello) Disable SSLv3 in KMS. (Robert Kanter via kasha)
(cherry picked from commit 87818ef4e7c1a49dc3b0d6766cceb3499b07b837)
2014-11-12 18:40:39 -08:00
Arun C. Murthy
42849e5077 HDFS-7387. Merging to branch-2.6 for hadoop-2.6.0-rc1.
(cherry picked from commit 09f36b1688a375f45c19889e326d5d35249882b1)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-11-12 11:51:11 -08:00
Brandon Li
d0ca88c5a1 HDFS-7387. NFS may only do partial commit due to a race between COMMIT and write. Contributed by Brandon Li
(cherry picked from commit 99d9d0c2d19b9f161b765947f3fb64619ea58090)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs-nfs/src/main/java/org/apache/hadoop/hdfs/nfs/nfs3/OpenFileCtx.java

(cherry picked from commit 0c3b7887e6a249bcab6c766137adcaea8afe1c67)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2014-11-12 11:50:04 -08:00
Zhijie Shen
1535e7211e YARN-2794. Fixed log messages about distributing system-credentials. Contributed by Jian He.
(cherry picked from commit be7bf956e96dd0fd9b521ca71df9124b9cc5ebd0)
2014-11-12 11:10:47 -08:00
Arun C. Murthy
de0073cbc4 YARN-2843. Merging to branch-2.6 for hadoop-2.6.0-rc1.
(cherry picked from commit 51957ca81886ac3553c44848631fdf53766a25ae)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-12 10:44:43 -08:00
Vinod Kumar Vavilapalli
7a8a413eb2 YARN-2843. Fixed NodeLabelsManager to trim inputs for hosts and labels so as to make them work correctly. Contributed by Wangda Tan.
(cherry picked from commit 0fd97f9c1989a793b882e6678285607472a3f75a)

Conflicts:
	hadoop-yarn-project/CHANGES.txt
2014-11-12 10:44:08 -08:00
Xuan
a690629ffc YARN-2841. RMProxy should retry EOFException. Contributed by Jian He 2014-11-12 10:28:55 -08:00
Arun C. Murthy
dc04b33768 HADOOP-9576. Merging to branch-2.6 for hadoop-2.6.0-rc1. 2014-11-12 10:01:09 -08:00
Jian He
aa2f87caaf HADOOP-9576. Changed NetUtils#wrapException to throw EOFException instead of wrapping it as IOException. Contributed by Steve Loughran
Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
2014-11-12 10:00:17 -08:00