Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
10,017 Commits 326 Branches 371 Tags
Commit Graph

10017 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Chris Douglas
79af15fd37 HDFS-8435. Support CreateFlag in WebHDFS. Contributed by Jakob Homan 2015-08-18 17:33:21 -07:00
Benoy Antony
d84e4a90d0 hadoop-12050. Enable MaxInactiveInterval for hadoop http auth token. Contributed by Huizhi Lu. 
(cherry picked from commit 71aedfabf39e03104c8d22456e95ef6349aae6c0)
 2015-08-18 13:53:47 -07:00
Allen Wittenauer
40d8faf868 HADOOP-9891. CLIMiniCluster instructions fail with MiniYarnCluster ClassNotFoundException (Darrell Taylor via aw) 
(cherry picked from commit 4d8fb8c19c04088cf8f8e9deecb571273adeaab5)
 2015-08-18 12:32:09 -07:00
Zhihai Xu
051a622b57 YARN-4057. If ContainersMonitor is not enabled, only print related log info one time. Contributed by Jun Gong. 
(cherry picked from commit 14215c8ef83d58b8443c52a3cb93e6d44fc87065)
 2015-08-18 11:47:41 -07:00
Zhihai Xu
8f2eb99d71 YARN-3857: Memory leak in ResourceManager with SIMPLE mode. Contributed by mujunchao. 
(cherry picked from commit 3a76a010b85176f2bcb85ed6f74c25dcb8acfe4d)
 2015-08-18 10:53:16 -07:00
Akira Ajisaka
38b344adfa HDFS-8852. HDFS architecture documentation of version 2.x is outdated about append write support. Contributed by Ajith S. 
(cherry picked from commit fc509f66d814e7a5ed81d5d73b23c400625d573b)
 2015-08-18 23:32:57 +09:00
Tsz-Wo Nicholas Sze
9ab89a9266 HDFS-8278. When computing max-size-to-move in Balancer, count only the storage with remaining >= default block size. 2015-08-17 18:42:41 -07:00
yliu
076c688780 HDFS-8862. BlockManager#excessReplicateMap should use a HashMap. (yliu) 2015-08-18 09:25:03 +08:00
Arpit Agarwal
85cb596e2e HDFS-8880. NameNode metrics logging. (Arpit Agarwal) 2015-08-17 16:55:24 -07:00
Colin Patrick Mccabe
39326ba71c HDFS-8845. DiskChecker should not traverse the entire tree (Chang Li via Colin P. McCabe) 2015-08-17 15:24:56 -07:00
Colin Patrick Mccabe
08508ca1c8 HDFS-8792. BlockManager#postponedMisreplicatedBlocks should use a LightWeightHashSet to save memory (Yi Liu via Colin P. McCabe) 
(cherry picked from commit c77bd6af16cbc26f88a2c6d8220db83a3e1caa2c)
 2015-08-17 12:07:16 -07:00
Haohui Mai
55f7097900 HDFS-8801. Convert BlockInfoUnderConstruction as a feature. Contributed by Jing Zhao. 2015-08-17 11:28:51 -07:00
Haohui Mai
4e712faac2 HDFS-6407. Add sorting and pagination in the datanode tab of the NN Web UI. Contributed by Haohui Mai. 2015-08-17 11:04:17 -07:00
Xiaoyu Yao
27ccbd51f6 HDFS-8883. NameNode Metrics : Add FSNameSystem lock Queue Length. Contributed by Anu Engineer. 
(cherry picked from commit a7862d5fe4c505f5d4b0c675438a971733f1f53a)
 2015-08-17 10:23:56 -07:00
Andrew Wang
9dcb426819 HDFS-8713. Convert DatanodeDescriptor to use SLF4J logging. 
(cherry picked from commit 3fe758436041d55da1ccde4d5109da38d1f5110f)
 2015-08-17 10:16:37 -07:00
Karthik Kambatla
d2ff763533 YARN-3534. Collect memory/cpu usage on the node. (Inigo Goiri via kasha) 
(cherry picked from commit def12933b38efd5e47c5144b729c1a1496f09229)
 2015-08-16 06:26:21 -07:00
Karthik Kambatla
20734320a1 MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha) 
(cherry picked from commit 8dfec7a1979e8f70f8355c096874921d368342ef)
 2015-08-15 00:53:13 -07:00
Jing Zhao
2edfc3ce71 HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang. 
(cherry picked from commit dc7a061668a3f4d86fe1b07a40d46774b5386938)
 2015-08-14 14:43:33 -07:00
Tsz-Wo Nicholas Sze
61b9e5f7ff HDFS-8824. Do not use small blocks for balancing the cluster. 2015-08-14 13:08:57 -07:00
Arpit Agarwal
b094f8b589 HDFS-7649. Multihoming docs should emphasize using hostnames in configurations. (Contributed by Brahma Reddy Battula) 2015-08-14 13:08:19 -07:00
Karthik Kambatla
b826168173 MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha) 
(cherry picked from commit 27d24f96ab8d17e839a1ef0d7076efc78d28724a)
 2015-08-14 12:40:38 -07:00
Xiaoyu Yao
17256e2ae8 HDFS-8565. Typo in dfshealth.html - Decomissioning. (nijel via xyao) 
(cherry picked from commit 1569228ec9090823186f062257fdf1beb5ee1781)
 2015-08-14 12:35:17 -07:00
Vinayakumar B
0b6574380c HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina) 
Moved to 2.6.1

(cherry picked from commit 84bf71295a5e52b2a7bb69440a885a25bc75f544)
 2015-08-14 16:13:47 +05:30
Vinayakumar B
eef0526127 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru) 
Moved to 2.6.1

(cherry picked from commit fc508b41a90a193f06a0e28ee40862bf9ee0f0c7)
 2015-08-14 15:55:45 +05:30
Vinayakumar B
796b94df1e HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 
Moved to 2.6.1

(cherry picked from commit 05ed69058f22ebeccc58faf0be491c269e950526)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-08-14 12:55:25 +05:30
Vinayakumar B
15760a148b HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang) 
Moved to 2.6.1

(cherry picked from commit 08bd4edf4092901273da0d73a5cc760fdc11052b)
 2015-08-14 12:38:23 +05:30
Vinayakumar B
a6ec5c3dec HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit e7aa81394dce61cc96d480e21204263a5f2ed153)
 2015-08-14 12:24:29 +05:30
Vinayakumar B
e0b1744de9 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit d6050f06a3b7e049541b1cb4597c388abf00a5be)
 2015-08-14 12:10:22 +05:30
Vinayakumar B
9839abe1a8 HDFS-7263. Snapshot read can reveal future bytes for appended files. Contributed by Tao Luo. 
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit fa2641143c0d74c4fef122d79f27791e15d3b43f)
 2015-08-14 11:46:30 +05:30
Vinayakumar B
c2a9c3929e HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlock (yzhang via cmccabe) 
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit f2b4bc9b6a1bd3f9dbfc4e85c1b9bde238da3627)
 2015-08-14 11:38:03 +05:30
Vinayakumar B
2c0063d420 HDFS-7213. processIncrementalBlockReport performance degradation. Contributed by Eric Payne. 
Moved CHANGES.TXT entry to 2.6.1

(cherry picked from commit d25cb8fe12d00faf3e8f3bfd23fd1b01981a340f)
 2015-08-14 11:24:12 +05:30
Arpit Agarwal
25c4dab891 HADOOP-12322. Typos in rpcmetrics.java. (Contributed by Anu Engineer) 2015-08-13 21:17:39 -07:00
Jian He
b2e869f2a8 YARN-3987. Send AM container completed msg to NM once AM finishes. Contributed by sandflee 
(cherry picked from commit 0a030546e24c55662a603bb63c9029ad0ccf43fc)
 2015-08-13 16:23:30 -07:00
Jian He
703fa1b141 YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe 
(cherry picked from commit 7a445fcfabcf9c6aae219051f65d3f6cb8feb87c)
 2015-08-13 16:13:28 -07:00
Jian He
4a5fdb7c23 YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong 
(cherry picked from commit 38aed1a94ed7b6da62e2445b5610bc02b1cddeeb)
 2015-08-13 14:46:34 -07:00
yliu
073cb16d81 HADOOP-12295. Improve NetworkTopology#InnerNode#remove logic. (yliu) 2015-08-13 16:42:40 +08:00
Akira Ajisaka
200fadedc0 HDFS-8622. Implement GETCONTENTSUMMARY operation for WebImageViewer. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 40f815131e822f5b7a8e6a6827f4b85b31220c43)
 2015-08-13 12:23:03 +09:00
cnauroth
bf8b09d4b8 HADOOP-12258. Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression. Contributed by Zhihai Xu. 
(cherry picked from commit 6cc8e38db5b26bdd02bc6bc1c9684db2593eec25)
 2015-08-12 16:45:05 -07:00
Robert Kanter
fbcfca6f91 YARN-4031. Add JvmPauseMonitor to ApplicationHistoryServer and WebAppProxyServer (djp via rkanter) 
(cherry picked from commit dc2340c60e33f903f8fd34958ec746c989016191)
 2015-08-12 15:48:14 -07:00
Xiaoyu Yao
458b684941 HDFS-8879. Quota by storage type usage incorrectly initialized upon namenode restart. Contributed by Xiaoyu Yao. 
(cherry picked from commit 3e715a4f4c46bcd8b3054cb0566e526c46bd5d66)
 2015-08-12 15:25:20 -07:00
Aaron T. Myers
43f386e748 HADOOP-12318. Expose underlying LDAP exceptions in SaslPlainServer. Contributed by Mike Yoder. 
(cherry picked from commit 28ea4c068ea0152af682058b02311bba81780770)
 2015-08-12 15:16:36 -07:00
Jian He
65d22b3686 YARN-4026. Refactored ContainerAllocator to accept a list of priorites rather than a single priority. Contributed by Wangda Tan 
(cherry picked from commit e5003be907acef87c2770e3f2914953f62017b0e)
 2015-08-12 15:09:46 -07:00
rohithsharmaks
c5b20e0db6 YARN-4023. Publish Application Priority to TimelineServer. (Sunil G via rohithsharmaks) 
(cherry picked from commit 1c12adb71f32f24ec525313ff8dfcd2b738fc8e2)
 2015-08-12 14:47:23 +05:30
Andrew Wang
d53296281a HDFS-8887. Expose storage type and storage ID in BlockLocation. 
(cherry picked from commit 1ea1a8334ea01814121490a5bfd2a0205c66d6e4)
 2015-08-11 23:33:06 -07:00
Xuan
2ebdf5bfce YARN-3999. RM hangs on draing events. Contributed by Jian He 
(cherry picked from commit 3ae716fa696b87e849dae40225dc59fb5ed114cb)
 2015-08-11 18:26:00 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
3dcff42437 Adding release 2.6.1 to CHANGES.txt 
(cherry picked from commit 7c796fd12ca5092d74e6cc7044f28496f9884983)
 2015-08-11 13:21:41 -07:00
Jing Zhao
f0e13c5499 HDFS-8805. Archival Storage: getStoragePolicy should not need superuser privilege. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1fc3c779a422bafdb86ad1a5b2349802dda1cb62)
 2015-08-11 10:28:48 -07:00
Jian He
df97e3265b YARN-3887. Support changing Application priority during runtime. Contributed by Sunil G 
(cherry picked from commit fa1d84ae2739a1e76f58b9c96d1378f9453cc0d2)
 2015-08-10 20:52:18 -07:00
Tsz-Wo Nicholas Sze
ac8d153046 HDFS-8818. Changes the global moveExecutor to per datanode executors and changes MAX_SIZE_TO_MOVE to be configurable. 2015-08-10 16:53:15 -07:00
Wangda Tan
380d401da5 YARN-3873. PendingApplications in LeafQueue should also use OrderingPolicy. (Sunil G via wangda) 
(cherry picked from commit cf9d3c925608e8bc650d43975382ed3014081057)
 2015-08-10 14:58:19 -07:00