Jason Lowe
a7eed5128b
YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li
2015-09-04 16:24:03 +00:00
Jason Lowe
1275ba2cac
Revert "YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li"
...
This reverts commit 71172a0bfc
.
2015-09-04 16:06:19 +00:00
Jason Lowe
71172a0bfc
YARN-4105. Capacity Scheduler headroom for DRF is wrong. Contributed by Chang Li
...
(cherry picked from commit 6eaca2e363
)
2015-09-04 15:32:14 +00:00
Varun Vasudev
5002f885fc
YARN-4103. RM WebServices missing scheme for appattempts logLinks. Contributed by Jonathan Eagles.
...
(cherry picked from commit 1b2e2ca9104dfc05e9aa7f93954ae2e00b3e62c4)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMAppBlock.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/RMWebServices.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/webapp/dao/AppAttemptInfo.java
2015-09-04 11:45:51 +05:30
Tsuyoshi Ozawa
76cfdb1aba
HADOOP-12213. Interrupted exception can occur when Client#stop is called. Contributed by Kuhu Shukla.
...
(cherry picked from commit 0ebc658105
)
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2015-09-03 23:34:12 +09:00
Tsuyoshi Ozawa
d09ddb7898
HADOOP-12006. Remove unimplemented option for from document in branch-2.7. Contributed by Akira AJISAKA.
2015-09-03 23:07:40 +09:00
Tsuyoshi Ozawa
139fd21c83
HADOOP-5323. Trash documentation should describe its directory structure and configurations. Contributed by Weiwei Yang.
...
(cherry picked from commit 9a87f81ce6
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HdfsDesign.md
2015-09-03 22:39:12 +09:00
Jian He
2d1ff2e1ca
YARN-4101. RM should print alert messages if Zookeeper and Resourcemanager gets connection issue. Contributed by Xuan Gong
...
(cherry picked from commit 09c64ba1ba
)
2015-09-02 17:46:24 -07:00
Rohith Sharma K S
c2ed7e4a09
YARN-3893. Both RM in active state when Admin#transitionToActive failure from refeshAll() (Bibin A Chundatt via rohithsharmaks)
...
(cherry picked from commit 7d6687fe76
)
2015-09-02 15:29:22 +05:30
yliu
3ab43accaf
HDFS-8995. Flaw in registration bookeeping can make DN die on reconnect. (Kihwal Lee via yliu)
2015-09-02 09:00:22 +08:00
Vinod Kumar Vavilapalli
015696fb81
YARN-3222. Added the missing CHANGES.txt entry.
...
(cherry picked from commit 4620767156
)
2015-09-01 13:44:51 -07:00
Tsuyoshi Ozawa
6078172fee
HADOOP-10365. BufferedOutputStream in FileUtil#unpackEntries() should be closed in finally block. Contributed by Kiran Kumar M R and Sanghyun Yun.
...
(cherry picked from commit dd149adeac
)
2015-09-02 02:02:28 +09:00
Akira Ajisaka
bcb98ba081
HADOOP-12359. hadoop fs -getmerge doc is wrong. Contributed by Jagadesh Kiran N.
...
(cherry picked from commit 2e251a7674
)
(cherry picked from commit 236c4ab511
)
2015-09-01 20:57:10 +09:00
Tsuyoshi Ozawa
1b5bf58001
YARN-2801. Add documentation for node labels feature. Contributed by Wangda Tan and Naganarasimha G R.
...
(cherry picked from commit faa38e1aa4
)
2015-09-01 17:56:08 +09:00
Jian He
f44ed4f4b0
YARN-4092. Fixed UI redirection to print useful messages when both RMs are in standby mode. Contributed by Xuan Gong
...
(cherry picked from commit a3fd2ccc86
)
(cherry picked from commit 48f5161cd5
)
2015-08-31 17:46:27 -07:00
Vinod Kumar Vavilapalli
dce4ef20f8
YARN-2945. Fixing the CHANGES.txt to have the right JIRA number.
...
(cherry picked from commit cf831565e8
)
2015-08-30 20:03:28 -07:00
Kihwal Lee
285dad32eb
fix merge error in CHANGES.TXT
2015-08-28 15:37:07 -05:00
Kihwal Lee
42aa880df3
HDFS-8879. Quota by storage type usage incorrectly initialized upon namenode restart. Contributed by Xiaoyu Yao.
...
(cherry picked from commit 3e715a4f4c
)
2015-08-28 13:27:17 -05:00
Jing Zhao
ba0f66984c
HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang.
...
(cherry picked from commit dc7a061668
)
(cherry picked from commit 2edfc3ce71
)
2015-08-20 20:42:20 -07:00
Vinod Kumar Vavilapalli
f333e367e1
MAPREDUCE-6454. Fixed MapReduce to modify HADOOP_CLASSPATH to have distributed cache files so that child processes running hadoop scripts can access these files. Contributed by Junping Du.
...
(cherry picked from commit 9da81a3955
)
2015-08-20 17:39:43 -07:00
Vinod Kumar Vavilapalli
9faee040f9
Creating 2.6.2 entries in CHANGES.txt files.
...
(cherry picked from commit 33474939a0
)
2015-08-20 17:39:29 -07:00
yliu
d4b6c4a3cd
HDFS-8863. The remaining space check in BlockPlacementPolicyDefault is flawed. (Kihwal Lee via yliu)
2015-08-20 20:43:26 +08:00
Akira Ajisaka
a2299bf4ee
HADOOP-12061. Incorrect command in single cluster setup document. Contributed by Kengo Seki.
...
(cherry picked from commit 5fb8ac18d1
)
2015-08-20 11:11:38 +09:00
Jing Zhao
4c005a4e16
HDFS-8867. Enable optimized block reports. Contributed by Daryn Sharp.
...
(cherry picked from commit f61120d964
)
(cherry picked from commit c0a4cd978a
)
2015-08-19 10:41:30 -07:00
Zhihai Xu
7409ed783e
YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao.
2015-08-18 12:08:20 -07:00
Akira Ajisaka
f98b5ae3bb
HDFS-8852. HDFS architecture documentation of version 2.x is outdated about append write support. Contributed by Ajith S.
...
(cherry picked from commit fc509f66d8
)
(cherry picked from commit 38b344adfa
)
2015-08-18 23:33:28 +09:00
Karthik Kambatla
d610144d45
MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha)
...
(cherry picked from commit 8dfec7a197
)
(cherry picked from commit 20734320a1
)
2015-08-15 00:56:22 -07:00
Vinayakumar B
4d94bc1d95
HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina)
...
Moved to 2.6.1
(cherry picked from commit 84bf71295a
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-08-14 16:15:10 +05:30
Vinayakumar B
ca3215a71b
HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru)
...
Moved to 2.6.1
(cherry picked from commit fc508b41a9
)
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
2015-08-14 15:57:40 +05:30
Vinayakumar B
b3546b6034
HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru)
...
(cherry picked from commit 295d678be8
)
(cherry picked from commit 80697e4f32
)
2015-08-14 15:50:11 +05:30
Vinayakumar B
d8d33055b0
HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe)
...
Moved to 2.6.1
(cherry picked from commit 05ed69058f
)
Conflicts:
hadoop-common-project/hadoop-common/CHANGES.txt
(cherry picked from commit 796b94df1e
)
2015-08-14 12:56:25 +05:30
Vinayakumar B
90f3641728
HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang)
...
Moved to 2.6.1
(cherry picked from commit 08bd4edf40
)
2015-08-14 12:38:59 +05:30
Vinayakumar B
8f4a09b607
HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu.
...
Moved CHANGES.txt entry to 2.6.1
(cherry picked from commit e7aa81394d
)
2015-08-14 12:24:59 +05:30
Vinayakumar B
a046f7e570
HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu.
...
Moved CHANGES.txt entry to 2.6.1
(cherry picked from commit d6050f06a3b7e049541b1cb4597c388abf00a5be)
2015-08-14 12:10:58 +05:30
Vinayakumar B
b06d342749
HDFS-7263. Snapshot read can reveal future bytes for appended files. Contributed by Tao Luo.
...
Moved CHANGES.txt entry to 2.6.1
(cherry picked from commit fa2641143c
)
2015-08-14 11:46:58 +05:30
Vinayakumar B
f40714f8d8
HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlock (yzhang via cmccabe)
...
Moved CHANGES.txt entry to 2.6.1
(cherry picked from commit f2b4bc9b6a
)
2015-08-14 11:38:28 +05:30
Vinayakumar B
5ba4065345
HDFS-7213. processIncrementalBlockReport performance degradation. Contributed by Eric Payne.
...
Moved CHANGES.TXT entry to 2.6.1
(cherry picked from commit d25cb8fe12
)
(cherry picked from commit 2c0063d420
)
Conflicts:
hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
2015-08-14 11:27:46 +05:30
Jian He
de1c4121a1
YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe
...
(cherry picked from commit 7a445fcfab
)
Conflicts:
hadoop-yarn-project/CHANGES.txt
2015-08-13 16:15:44 -07:00
Xuan
617e294a63
YARN-3999. RM hangs on draing events. Contributed by Jian He
2015-08-11 18:27:23 -07:00
Vinod Kumar Vavilapalli
67ef0989bc
Adding release 2.6.1 to CHANGES.txt
2015-08-11 13:25:36 -07:00
Jian He
c170f58a59
HADOOP-11932. MetricsSinkAdapter may hang when being stopped. Contributed by Brahma Reddy Battula
...
(cherry picked from commit f59612edd7
)
2015-08-05 16:14:35 -07:00
cnauroth
015d868367
HADOOP-12304. Applications using FileContext fail with the default file system configured to be wasb/s3/etc. Contributed by Chris Nauroth.
...
(cherry picked from commit 3da0bedaec
)
(cherry picked from commit b83d475252
)
2015-08-05 14:57:03 -07:00
Jonathan Eagles
dcffe43419
YARN-3978. Configurably turn off the saving of container info in Generic AHS (Eric Payne via jeagles)
...
(cherry picked from commit 3cd02b9522
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/TestLeafQueue.java
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fifo/TestFifoScheduler.java
2015-08-03 10:53:43 -05:00
Jason Lowe
e1ae722a7d
YARN-3990. AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected. Contributed by Bibin A Chundatt
...
(cherry picked from commit 32e490b6c0
)
2015-07-31 17:39:32 +00:00
Jason Lowe
e8410c0175
YARN-3925. ContainerLogsUtils#getContainerLogFile fails to read container log files from full disks. Contributed by zhihai xu
...
(cherry picked from commit ff9c13e0a7
)
Conflicts:
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/java/org/apache/hadoop/yarn/server/nodemanager/webapp/TestContainerLogsPage.java
2015-07-24 22:27:52 +00:00
carlo curino
b465c5b907
YARN-3969. Updating CHANGES.txt to reflect the correct set of branches where this is committed
...
(cherry picked from commit fc42fa8ae3
)
(cherry picked from commit bddc48ed86
)
2015-07-24 13:42:13 -07:00
Xuan
c65b6b760f
YARN-3967. Fetch the application report from the AHS if the RM does not
...
know about it. Contributed by Mit Desai
(cherry picked from commit fbd6063269
)
(cherry picked from commit 98ed4bca3b
)
2015-07-24 10:17:51 -07:00
carlo curino
76339bfb9f
YARN-3969. Allow jobs to be submitted to reservation that is active but does not have any allocations. (subru via curino)
...
(cherry picked from commit 0fcb4a8cf2
)
(cherry picked from commit 6a71a0a230
)
2015-07-24 08:54:59 -07:00
Akira Ajisaka
b919c1c044
HDFS-8806. Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared. Contributed by Zhe Zhang.
...
(cherry picked from commit 206d4933a5
)
(cherry picked from commit b2a532f61c
)
2015-07-24 18:38:44 +09:00
Jian He
65af0dffa5
YARN-3878. AsyncDispatcher can hang while stopping if it is configured for draining events on stop. Contributed by Varun Saxena
...
(cherry picked from commit 393fe71771
)
2015-07-21 15:06:32 -07:00