Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9,753 Commits 326 Branches 371 Tags
Commit Graph

9753 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Wang
9dcb426819 HDFS-8713. Convert DatanodeDescriptor to use SLF4J logging. 
(cherry picked from commit 3fe758436041d55da1ccde4d5109da38d1f5110f)
 2015-08-17 10:16:37 -07:00
Karthik Kambatla
d2ff763533 YARN-3534. Collect memory/cpu usage on the node. (Inigo Goiri via kasha) 
(cherry picked from commit def12933b38efd5e47c5144b729c1a1496f09229)
 2015-08-16 06:26:21 -07:00
Karthik Kambatla
20734320a1 MAPREDUCE-6439. AM may fail instead of retrying if RM shuts down during the allocate call. (Anubhav Dhoot via kasha) 
(cherry picked from commit 8dfec7a1979e8f70f8355c096874921d368342ef)
 2015-08-15 00:53:13 -07:00
Jing Zhao
2edfc3ce71 HDFS-8891. HDFS concat should keep srcs order. Contributed by Yong Zhang. 
(cherry picked from commit dc7a061668a3f4d86fe1b07a40d46774b5386938)
 2015-08-14 14:43:33 -07:00
Tsz-Wo Nicholas Sze
61b9e5f7ff HDFS-8824. Do not use small blocks for balancing the cluster. 2015-08-14 13:08:57 -07:00
Arpit Agarwal
b094f8b589 HDFS-7649. Multihoming docs should emphasize using hostnames in configurations. (Contributed by Brahma Reddy Battula) 2015-08-14 13:08:19 -07:00
Karthik Kambatla
b826168173 MAPREDUCE-5817. Mappers get rescheduled on node transition even after all reducers are completed. (Sangjin Lee via kasha) 
(cherry picked from commit 27d24f96ab8d17e839a1ef0d7076efc78d28724a)
 2015-08-14 12:40:38 -07:00
Xiaoyu Yao
17256e2ae8 HDFS-8565. Typo in dfshealth.html - Decomissioning. (nijel via xyao) 
(cherry picked from commit 1569228ec9090823186f062257fdf1beb5ee1781)
 2015-08-14 12:35:17 -07:00
Vinayakumar B
0b6574380c HDFS-8270. create() always retried with hardcoded timeout when file already exists with open lease (Contributed by J.Andreina) 
Moved to 2.6.1

(cherry picked from commit 84bf71295a5e52b2a7bb69440a885a25bc75f544)
 2015-08-14 16:13:47 +05:30
Vinayakumar B
eef0526127 HADOOP-7139. Allow appending to existing SequenceFiles (Contributed by kanaka kumar avvaru) 
Moved to 2.6.1

(cherry picked from commit fc508b41a90a193f06a0e28ee40862bf9ee0f0c7)
 2015-08-14 15:55:45 +05:30
Vinayakumar B
796b94df1e HADOOP-11333. Fix deadlock in DomainSocketWatcher when the notification pipe is full (zhaoyunjiong via cmccabe) 
Moved to 2.6.1

(cherry picked from commit 05ed69058f22ebeccc58faf0be491c269e950526)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-08-14 12:55:25 +05:30
Vinayakumar B
15760a148b HDFS-7225. Remove stale block invalidation work when DN re-registers with different UUID. (Zhe Zhang and Andrew Wang) 
Moved to 2.6.1

(cherry picked from commit 08bd4edf4092901273da0d73a5cc760fdc11052b)
 2015-08-14 12:38:23 +05:30
Vinayakumar B
a6ec5c3dec HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit e7aa81394dce61cc96d480e21204263a5f2ed153)
 2015-08-14 12:24:29 +05:30
Vinayakumar B
e0b1744de9 HADOOP-10786. Fix UGI#reloginFromKeytab on Java 8. Contributed by Stephen Chu. 
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit d6050f06a3b7e049541b1cb4597c388abf00a5be)
 2015-08-14 12:10:22 +05:30
Vinayakumar B
9839abe1a8 HDFS-7263. Snapshot read can reveal future bytes for appended files. Contributed by Tao Luo. 
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit fa2641143c0d74c4fef122d79f27791e15d3b43f)
 2015-08-14 11:46:30 +05:30
Vinayakumar B
c2a9c3929e HDFS-7235. DataNode#transferBlock should report blocks that don't exist using reportBadBlock (yzhang via cmccabe) 
Moved CHANGES.txt entry to 2.6.1

(cherry picked from commit f2b4bc9b6a1bd3f9dbfc4e85c1b9bde238da3627)
 2015-08-14 11:38:03 +05:30
Vinayakumar B
2c0063d420 HDFS-7213. processIncrementalBlockReport performance degradation. Contributed by Eric Payne. 
Moved CHANGES.TXT entry to 2.6.1

(cherry picked from commit d25cb8fe12d00faf3e8f3bfd23fd1b01981a340f)
 2015-08-14 11:24:12 +05:30
Arpit Agarwal
25c4dab891 HADOOP-12322. Typos in rpcmetrics.java. (Contributed by Anu Engineer) 2015-08-13 21:17:39 -07:00
Jian He
b2e869f2a8 YARN-3987. Send AM container completed msg to NM once AM finishes. Contributed by sandflee 
(cherry picked from commit 0a030546e24c55662a603bb63c9029ad0ccf43fc)
 2015-08-13 16:23:30 -07:00
Jian He
703fa1b141 YARN-4047. ClientRMService getApplications has high scheduler lock contention. Contributed by Jason Lowe 
(cherry picked from commit 7a445fcfabcf9c6aae219051f65d3f6cb8feb87c)
 2015-08-13 16:13:28 -07:00
Jian He
4a5fdb7c23 YARN-4005. Completed container whose app is finished is possibly not removed from NMStateStore. Contributed by Jun Gong 
(cherry picked from commit 38aed1a94ed7b6da62e2445b5610bc02b1cddeeb)
 2015-08-13 14:46:34 -07:00
yliu
073cb16d81 HADOOP-12295. Improve NetworkTopology#InnerNode#remove logic. (yliu) 2015-08-13 16:42:40 +08:00
Akira Ajisaka
200fadedc0 HDFS-8622. Implement GETCONTENTSUMMARY operation for WebImageViewer. Contributed by Jagadesh Kiran N. 
(cherry picked from commit 40f815131e822f5b7a8e6a6827f4b85b31220c43)
 2015-08-13 12:23:03 +09:00
cnauroth
bf8b09d4b8 HADOOP-12258. Need translate java.nio.file.NoSuchFileException to FileNotFoundException to avoid regression. Contributed by Zhihai Xu. 
(cherry picked from commit 6cc8e38db5b26bdd02bc6bc1c9684db2593eec25)
 2015-08-12 16:45:05 -07:00
Robert Kanter
fbcfca6f91 YARN-4031. Add JvmPauseMonitor to ApplicationHistoryServer and WebAppProxyServer (djp via rkanter) 
(cherry picked from commit dc2340c60e33f903f8fd34958ec746c989016191)
 2015-08-12 15:48:14 -07:00
Xiaoyu Yao
458b684941 HDFS-8879. Quota by storage type usage incorrectly initialized upon namenode restart. Contributed by Xiaoyu Yao. 
(cherry picked from commit 3e715a4f4c46bcd8b3054cb0566e526c46bd5d66)
 2015-08-12 15:25:20 -07:00
Aaron T. Myers
43f386e748 HADOOP-12318. Expose underlying LDAP exceptions in SaslPlainServer. Contributed by Mike Yoder. 
(cherry picked from commit 28ea4c068ea0152af682058b02311bba81780770)
 2015-08-12 15:16:36 -07:00
Jian He
65d22b3686 YARN-4026. Refactored ContainerAllocator to accept a list of priorites rather than a single priority. Contributed by Wangda Tan 
(cherry picked from commit e5003be907acef87c2770e3f2914953f62017b0e)
 2015-08-12 15:09:46 -07:00
rohithsharmaks
c5b20e0db6 YARN-4023. Publish Application Priority to TimelineServer. (Sunil G via rohithsharmaks) 
(cherry picked from commit 1c12adb71f32f24ec525313ff8dfcd2b738fc8e2)
 2015-08-12 14:47:23 +05:30
Andrew Wang
d53296281a HDFS-8887. Expose storage type and storage ID in BlockLocation. 
(cherry picked from commit 1ea1a8334ea01814121490a5bfd2a0205c66d6e4)
 2015-08-11 23:33:06 -07:00
Xuan
2ebdf5bfce YARN-3999. RM hangs on draing events. Contributed by Jian He 
(cherry picked from commit 3ae716fa696b87e849dae40225dc59fb5ed114cb)
 2015-08-11 18:26:00 -07:00
Vinod Kumar Vavilapalli (I am also known as @tshooter.)
3dcff42437 Adding release 2.6.1 to CHANGES.txt 
(cherry picked from commit 7c796fd12ca5092d74e6cc7044f28496f9884983)
 2015-08-11 13:21:41 -07:00
Jing Zhao
f0e13c5499 HDFS-8805. Archival Storage: getStoragePolicy should not need superuser privilege. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 1fc3c779a422bafdb86ad1a5b2349802dda1cb62)
 2015-08-11 10:28:48 -07:00
Jian He
df97e3265b YARN-3887. Support changing Application priority during runtime. Contributed by Sunil G 
(cherry picked from commit fa1d84ae2739a1e76f58b9c96d1378f9453cc0d2)
 2015-08-10 20:52:18 -07:00
Tsz-Wo Nicholas Sze
ac8d153046 HDFS-8818. Changes the global moveExecutor to per datanode executors and changes MAX_SIZE_TO_MOVE to be configurable. 2015-08-10 16:53:15 -07:00
Wangda Tan
380d401da5 YARN-3873. PendingApplications in LeafQueue should also use OrderingPolicy. (Sunil G via wangda) 
(cherry picked from commit cf9d3c925608e8bc650d43975382ed3014081057)
 2015-08-10 14:58:19 -07:00
Jakob Homan
e771dbefe9 HDFS-8866. Typo in docs: Rumtime -> Runtime. Contributed by Gabor Liptak. 
(cherry picked from commit 8f73bdd06b16d5048ffb6071bbcecf849c6225db)
 2015-08-07 11:39:54 -07:00
Wangda Tan
cdb61b5fb2 YARN-3966. Fix excessive loggings in CapacityScheduler. (Jian He via wangda) 
(cherry picked from commit 4bc42d76e7fa53cb268cab0f9fe1fd8d8dbb17fd)
 2015-08-07 09:53:42 -07:00
Andrew Wang
0c4c7b3b62 HDFS-8772. Fix TestStandbyIsHot#testDatanodeRestarts which occasionally fails. Contributed by Walter Su. 2015-08-07 09:53:04 -07:00
Rohith Sharma K S
a0da1ec010 YARN-3948. Display Application Priority in RM Web UI.(Sunil G via rohithsharmaks) 
(cherry picked from commit b6265d39c5d0fda21dfe55273f193d8a6a20c6a8)
 2015-08-07 10:47:08 +05:30
Arpit Agarwal
42a05d29ee HDFS-8856. Make LeaseManager#countPath O(1). (Contributed by Arpit Agarwal) 2015-08-06 18:52:07 -07:00
Carlo Curino
8e23a7997f YARN-3974. Refactor the reservation system test cases to use parameterized base test. (subru via curino) 
(cherry picked from commit 8572a5a14b999a866fa64ce32ee20078ffefdb1e)
 2015-08-02 02:06:06 -07:00
Jing Zhao
d7d804623e Revert "HDFS-8499. Refactor BlockInfo class hierarchy with static helper class. Contributed by Zhe Zhang." 
This reverts commit c17439c2ddd921b63b1635e6f1cba634b8da8557.

(cherry picked from commit f4c523b69ba55b1fd35e8995c3011a9f546ac835)
 2015-08-06 10:26:09 -07:00
Jing Zhao
2c694286b4 Revert "HDFS-8623. Refactor NameNode handling of invalid, corrupt, and under-recovery blocks. Contributed by Zhe Zhang." 
This reverts commit de480d6c8945bd8b5b00e8657b7a72ce8dd9b6b5.

(cherry picked from commit 663eba0ab1c73b45f98e46ffc87ad8fd91584046)
 2015-08-06 10:25:54 -07:00
Junping Du
c8469357ba MAPREDUCE-6443. Add JvmPauseMonitor to JobHistoryServer. Contributed by Robert Kanter. 2015-08-06 07:00:42 -07:00
Junping Du
7af531d2e3 YARN-4019. Add JvmPauseMonitor to ResourceManager and NodeManager. Contributed by Robert Kanter. 
(cherry picked from commit cfee02b3bdd1117370200c9d8ce216676cff8888)
 2015-08-06 06:50:40 -07:00
Arun Suresh
84ea7cd408 YARN-3961. Expose pending, running and reserved containers of a queue in REST api and yarn top (adhoot via asuresh) 
(cherry picked from commit 154c9d2e421390c808dea3b2826cdaae492ea337)
 2015-08-05 23:15:33 -07:00
Vinayakumar B
f8932d478f HDFS-8815. DFS getStoragePolicy implementation using single RPC call (Contributed by Surendra Singh Lilhore) 
(cherry picked from commit cc71ad80e184fc6e5043729e8cfcf6a62ca3e71f)
 2015-08-06 11:11:59 +05:30
rohithsharmaks
dc76c4b035 YARN-3992. TestApplicationPriority.testApplicationPriorityAllocation fails intermittently. (Contributed by Sunil G) 
(cherry picked from commit df9e7280db58baddd02d6e23d3685efb8d5f1b97)
 2015-08-06 10:49:37 +05:30
Jian He
5950c1f6f8 HADOOP-11932. MetricsSinkAdapter may hang when being stopped. Contributed by Brahma Reddy Battula 
(cherry picked from commit f59612edd74d1bef2b60870c24c1f67c56b2b3cb)
 2015-08-05 16:14:09 -07:00