Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,915 Commits 326 Branches 371 Tags
Commit Graph

8915 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Harsh J
6ab1a9c2de HADOOP-8151. Error handling in snappy decompressor throws invalid exceptions. Contributed by Matt Foley. (harsh) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389006 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit ac31d6a4485d7ff9074fb5dade7a6cf5292bb347)

Conflicts:

	hadoop-common-project/hadoop-common/CHANGES.txt

(cherry picked from commit 55427fb66c6d52ce98b4d68a29b592a734014c28)
 2015-09-10 11:56:29 -07:00
Jing Zhao
6c127b44ca HDFS-7609. Avoid retry cache collision when Standby NameNode loading edits. Contributed by Ming Ma. 
(cherry picked from commit 7817674a3a4d097b647dd77f1345787dd376d5ea)
(cherry picked from commit 17fb442a4c4e43105374c97fccd68dd966729a19)
 2015-09-10 11:56:28 -07:00
cnauroth
188096f1fe HDFS-8431. hdfs crypto class not found in Windows. Contributed by Anu Engineer. 
(cherry picked from commit 50eeea13000f0c82e0567410f0f8b611248f8c1b)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/main/bin/hdfs.cmd

(cherry picked from commit 25db34127811fbadb9a698fa3a76e24d426fb0f6)
 2015-09-10 11:56:27 -07:00
Zhijie Shen
e48bffd055 YARN-3700. Made generic history service load a number of latest applications according to the parameter or the configuration. Contributed by Xuan Gong. 
(cherry picked from commit 54504133f41e36eaea6bb06c7b9ddb249468ecd7)
(cherry picked from commit 839f81a6326b2f8b3d5183178382c1551b0bc259)
 2015-09-10 11:56:27 -07:00
Xiaoyu Yao
d3562b4e1d HDFS-8219. setStoragePolicy with folder behavior is different after cluster restart. (surendra singh lilhore via Xiaoyu Yao) 
(cherry picked from commit 0100b155019496d077f958904de7d385697d65d9)
(cherry picked from commit e68e8b3b5cff85bfd8bb5b00b9033f63577856d6)
 2015-09-10 11:56:22 -07:00
Jason Lowe
4ea42b84b7 MAPREDUCE-5649. Reduce cannot use more than 2G memory for the final merge. Contributed by Gera Shegalov 
(cherry picked from commit 7dc3c1203d1ab14c09d0aaf0869a5bcdfafb0a5a)

(cherry picked from commit 87c2d915f1cc799cb4020c945c04d3ecb82ee963)
 2015-09-10 11:00:00 -07:00
Gera Shegalov
afa8189a07 HADOOP-11491. HarFs incorrectly declared as requiring an authority. (Brahma Reddy Battula via gera) 
(cherry picked from commit f343f8657e2b01773a32c2c7d960dc368954b42e)
(cherry picked from commit 58970d69de8a1662e4548cd6d4ca460dd70562f8)
 2015-09-10 10:57:52 -07:00
Gera Shegalov
d3f41f6ed8 HADOOP-11812. Implement listLocatedStatus for ViewFileSystem to speed up split calculation (gera) 
(cherry picked from commit 6d2cf9fbbd02482315a091ab07af26e40cc5134f)
(cherry picked from commit 1544c63602089b690e850e0e30af4589513a2371)
 2015-09-10 10:56:15 -07:00
Hitesh Shah
f6b7dc24f0 YARN-2890. MiniYarnCluster should turn on timeline service if configured to do so. Contributed by Mit Desai. 
(cherry picked from commit 265ed1fe804743601a8b62cabc1e4dc2ec8e502f)
(cherry picked from commit 55b794e7fa205df655c19bbfe1de99091fa9dc64)
 2015-09-10 10:55:23 -07:00
Kihwal Lee
cfb27d7f78 HDFS-8046. Allow better control of getContentSummary. Contributed by Kihwal Lee. 
(cherry picked from commit 285b31e75e51ec8e3a796c2cb0208739368ca9b8)

(cherry picked from commit 7e622076d41a85fc9a8600fb270564a085f5cd83)
 2015-09-10 10:53:19 -07:00
Jason Lowe
d1186dbafa MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors. Contributed by Kuhu Shukla 
(cherry picked from commit 8e615588d5216394d0251a9c97bd706537856c6d)
 2015-09-10 16:05:48 +00:00
Akira Ajisaka
c5a74c5c37 HDFS-9033. dfsadmin -metasave prints "NaN" for cache used%. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 0113e4528deda7563b62a29745fbf209ab31b81a)
(cherry picked from commit eb9e06f8e30a6f930db478683739230f8f5ada5d)
 2015-09-09 17:23:25 +09:00
Zhihai Xu
4b5767e456 YARN-4096. App local logs are leaked if log aggregation fails to initialize for the app. Contributed by Jason Lowe. 
(cherry picked from commit 16b9037dc1300b8bdbe54ba7cd47c53fe16e93d8)
 2015-09-08 12:43:55 -07:00
Jing Zhao
fd100ccbae HDFS-8384. Allow NN to startup if there are files having a lease but are not under construction. Contributed by Jing Zhao. 2015-09-08 10:52:42 -07:00
Xuan
b55fb0ac44 YARN-4087. Followup fixes after YARN-2019 regarding RM behavior when 
state-store error occurs. Contributed by Jian He

(cherry picked from commit 9b78e6e33d8c117c1e909df414f20d9db56efe4b)
(cherry picked from commit a0b7ef15d0663076b65ae3f53271b54e42308bfb)
 2015-09-07 17:47:32 -07:00
Xuan
96b9455c6f YARN-2019. Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore. Contributed by Jian He. 2015-09-07 17:23:56 -07:00
Tsuyoshi Ozawa
e8a15495bc MAPREDUCE-6442. Stack trace is missing when error occurs in client protocol provider's constructor Contributed by Chang Li. 
(cherry picked from commit 9b685773ec1031e90cc2b8aedb42670721757e22)
 2015-09-05 11:24:30 +09:00
Jason Lowe
a7eed5128b YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li 2015-09-04 16:24:03 +00:00
Jason Lowe
1275ba2cac Revert "YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li" 
This reverts commit 71172a0bfcf549f13bf17c1f1cbb4996272dd470.
 2015-09-04 16:06:19 +00:00
Jason Lowe
71172a0bfc YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li 
(cherry picked from commit 6eaca2e3634a88dc55689e8960352d6248c424d9)
 2015-09-04 15:32:14 +00:00
Varun Vasudev
5002f885fc YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles. 
(cherry picked from commit 1b2e2ca9104dfc05e9aa7f93954ae2e00b3e62c4)

Conflicts:
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppBlock.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMWebServices.java
	hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppAttemptInfo.java
 2015-09-04 11:45:51 +05:30
Tsuyoshi Ozawa
76cfdb1aba HADOOP-12213. Interrupted exception can occur when Client#stop is called. Contributed by Kuhu Shukla. 
(cherry picked from commit 0ebc658105336cfe3e1a248b411de60f1d380928)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-09-03 23:34:12 +09:00
Tsuyoshi Ozawa
d09ddb7898 HADOOP-12006. Remove unimplemented option for from document in branch-2.7. Contributed by Akira AJISAKA. 2015-09-03 23:07:40 +09:00
Tsuyoshi Ozawa
139fd21c83 HADOOP-5323. Trash documentation should describe its directory structure and configurations. Contributed by Weiwei Yang. 
(cherry picked from commit 9a87f81ce6839d1b5ab3d663c1e82c7e572bdeb8)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsDesign.md
 2015-09-03 22:39:12 +09:00
Jian He
2d1ff2e1ca YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong 
(cherry picked from commit 09c64ba1ba8be7a2ac31f4e42efb8c99b682399f)
 2015-09-02 17:46:24 -07:00
Rohith Sharma K S
c2ed7e4a09 YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks) 
(cherry picked from commit 7d6687fe76f6152a577ff2298c358dd30fce41fb)
 2015-09-02 15:29:22 +05:30
yliu
3ab43accaf HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu) 2015-09-02 09:00:22 +08:00
Vinod Kumar Vavilapalli
015696fb81 YARN-3222. Added the missing CHANGES.txt entry. 
(cherry picked from commit 4620767156ecc43424bc6c7c4d50519e2563cc69)
 2015-09-01 13:44:51 -07:00
Tsuyoshi Ozawa
6078172fee HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block. Contributed by Kiran Kumar M R and Sanghyun Yun. 
(cherry picked from commit dd149adeace8727864371c5a1484c6534f8b450b)
 2015-09-02 02:02:28 +09:00
Akira Ajisaka
bcb98ba081 HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 2e251a767427a38ecb6c309ad979feecb29a09f4)
(cherry picked from commit 236c4ab511055d0b67d2c73160125cc63015ac07)
 2015-09-01 20:57:10 +09:00
Tsuyoshi Ozawa
1b5bf58001 YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R. 
(cherry picked from commit faa38e1aa49907254bf981662a8aeb5dc52e75e3)
 2015-09-01 17:56:08 +09:00
Jian He
f44ed4f4b0 YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong 
(cherry picked from commit a3fd2ccc869dfc1f04d1cf0a8678d4d90a43a80f)
(cherry picked from commit 48f5161cd5d4c2f4e385b253a5bea066b2e23b9e)
 2015-08-31 17:46:27 -07:00
Vinod Kumar Vavilapalli
dce4ef20f8 YARN-2945. Fixing the CHANGES.txt to have the right JIRA number. 
(cherry picked from commit cf831565e8344523e1bd0eaf686ed56a2b48b920)
 2015-08-30 20:03:28 -07:00
Kihwal Lee
285dad32eb fix merge error in CHANGES.TXT 2015-08-28 15:37:07 -05:00
Kihwal Lee
42aa880df3 HDFS-8879. Quota by storage type usage incorrectly initialized upon namenode restart. Contributed by Xiaoyu Yao. 
(cherry picked from commit 3e715a4f4c46bcd8b3054cb0566e526c46bd5d66)
 2015-08-28 13:27:17 -05:00
Jing Zhao
ba0f66984c HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang. 
(cherry picked from commit dc7a061668a3f4d86fe1b07a40d46774b5386938)
(cherry picked from commit 2edfc3ce715e47ce8deb1525f0040635fd8cf3a6)
 2015-08-20 20:42:20 -07:00
Vinod Kumar Vavilapalli
f333e367e1 MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed cache files so that child processes running hadoop scripts can access these files. Contributed by Junping Du. 
(cherry picked from commit 9da81a395584cb1dbfdee012222fd4de53522681)
 2015-08-20 17:39:43 -07:00
Vinod Kumar Vavilapalli
9faee040f9 Creating 2.6.2 entries in CHANGES.txt files. 
(cherry picked from commit 33474939a048ac7bbe07df772f0000c84979722f)
 2015-08-20 17:39:29 -07:00
yliu
d4b6c4a3cd HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed. (Kihwal Lee via yliu) 2015-08-20 20:43:26 +08:00
Akira Ajisaka
a2299bf4ee HADOOP-12061. Incorrect command in single cluster setup document. Contributed by Kengo Seki. 
(cherry picked from commit 5fb8ac18d1262b248c01eff03e91020340ae88de)
 2015-08-20 11:11:38 +09:00
Jing Zhao
4c005a4e16 HDFS-8867. Enable optimized block reports. Contributed by Daryn Sharp. 
(cherry picked from commit f61120d964a609ae5eabeb5c4d6c9afe0a15cad8)
(cherry picked from commit c0a4cd978a9142a1fb9f6367d9af0dc7f0e711d9)
 2015-08-19 10:41:30 -07:00
Zhihai Xu
7409ed783e YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao. 2015-08-18 12:08:20 -07:00
Akira Ajisaka
f98b5ae3bb HDFS-8852. HDFS architecture documentation of version 2.x is outdated about append write support. Contributed by Ajith S. 
(cherry picked from commit fc509f66d814e7a5ed81d5d73b23c400625d573b)
(cherry picked from commit 38b344adfa7a0e57cad8931fb5c699ad4d48150f)
 2015-08-18 23:33:28 +09:00
Karthik Kambatla
d610144d45 MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha) 
(cherry picked from commit 8dfec7a1979e8f70f8355c096874921d368342ef)
(cherry picked from commit 20734320a18f12a28e6e4cd7b73dfcb5df869696)
 2015-08-15 00:56:22 -07:00
Vinayakumar B
4d94bc1d95 HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina) 
Moved to 2.6.1

(cherry picked from commit 84bf71295a5e52b2a7bb69440a885a25bc75f544)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-08-14 16:15:10 +05:30
Vinayakumar B
ca3215a71b HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru) 
Moved to 2.6.1

(cherry picked from commit fc508b41a90a193f06a0e28ee40862bf9ee0f0c7)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-08-14 15:57:40 +05:30
Vinayakumar B
b3546b6034 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru) 
(cherry picked from commit 295d678be8853a52c3ec3da43d9265478d6632b3)
(cherry picked from commit 80697e4f324948ec32b4cad3faccba55287be652)
 2015-08-14 15:50:11 +05:30
Vinayakumar B
d8d33055b0 HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 
Moved to 2.6.1

(cherry picked from commit 05ed69058f22ebeccc58faf0be491c269e950526)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt

(cherry picked from commit 796b94df1ea0269617417bb7889ed4035ed0f5a2)
 2015-08-14 12:56:25 +05:30
Vinayakumar B
90f3641728 HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang) 
Moved to 2.6.1

(cherry picked from commit 08bd4edf4092901273da0d73a5cc760fdc11052b)
 2015-08-14 12:38:59 +05:30
Vinayakumar B
8f4a09b607 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit e7aa81394dce61cc96d480e21204263a5f2ed153)
 2015-08-14 12:24:59 +05:30