Apache/hadoop
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
8,982 Commits 326 Branches 371 Tags
Commit Graph

8982 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kihwal Lee
2b9173059d HDFS-7932. Speed up the shutdown of datanode during rolling upgrade. Contributed by Kihwal Lee. 
(cherry picked from commit 61a4c7fc9891def0e85edf7e41d74c6b92c85fdb)
 2015-03-19 12:28:36 -05:00
Tsuyoshi Ozawa
ef9aa7c34b MAPREDUCE-6281. Fix javadoc in Terasort. Contributed by Albert Chu. 
(cherry picked from commit 1ccbc29708f7e89b9292a861df3bc3b8f4f7febe)
 2015-03-20 00:59:43 +09:00
Tsuyoshi Ozawa
0eeb760c55 HADOOP-11729. Fix link to cgroups doc in site.xml. Contributed by Masatake Iwasaki. 
(cherry picked from commit 522c897146aa4e9588d3c25639750c8ed712ef9e)
 2015-03-19 23:08:41 +09:00
Vinayakumar B
786ba9784d HDFS.7849. Update documentation for enabling a new feature in rolling upgrade ( Contributed by J.Andreina ) 
(cherry picked from commit 5be5129d93481e9caae6a05b2361c463211a6d55)
 2015-03-19 19:06:47 +05:30
Kihwal Lee
ceb39c1cc6 HDFS-7816. Unable to open webhdfs paths with "+". Contributed by Haohui Mai 
(cherry picked from commit e79be0ee123d05104eb34eb854afcf9fa78baef2)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-03-19 08:03:47 -05:00
Devaraj K
a888dac344 YARN-3357. Move TestFifoScheduler to FIFO package. Contributed by Rohith 
Sharmaks.

(cherry picked from commit 93d0f4acc8454b7a460da8883fbd14f14a575370)
 2015-03-19 12:18:08 +05:30
Vinayakumar B
25515d1421 HDFS-7867. Update action param from 'start' to 'prepare' in rolling upgrade ( Contributed by J.Andreina) Updated JIRA id. 
(cherry picked from commit 355e008ffbb0a33cb7d5782fc291abd62d684aaa)
 2015-03-19 12:11:34 +05:30
Vinayakumar B
4527aa6f77 HDFS-7869. Update action param from 'start' to 'prepare' in rolling upgrade ( Contributed by J.Andreina) 
(cherry picked from commit 338b477ff736cb6c8fb8204ab83fb038594dadf0)
 2015-03-19 12:01:05 +05:30
Haohui Mai
b36fc6bc9c HADOOP-10703. HttpServer2 creates multiple authentication filters. Contributed by Benoy Antony. 2015-03-18 22:32:19 -07:00
Colin Patrick Mccabe
b02f77540c HADOOP-9329. document native build dependencies in BUILDING.txt (Vijay Bhat via Colin P. McCabe) 
(cherry picked from commit bf6295bed8b58432ede44e074fa7998d55c4b821)
 2015-03-18 19:14:58 -07:00
Colin Patrick Mccabe
219eb22c15 HDFS-7929. inotify unable fetch pre-upgrade edit log segments once upgrade starts (Zhe Zhang via Colin P. McCabe) 
(cherry picked from commit 43b41f22411439c5e23629197fb2fde45dcf0f0f)
 2015-03-18 19:08:30 -07:00
Jing Zhao
5a5b244648 HDFS-7587. Edit log corruption can happen if append fails with a quota violation. Contributed by Jing Zhao. 
(cherry picked from commit c7c71cdba50cb7d8282622cd496cc913c80cff54)

Conflicts:
	hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
 2015-03-18 18:56:56 -07:00
Jing Zhao
6dcc79507d HDFS-7943. Append cannot handle the last block with length greater than the preferred block size. Contributed by Jing Zhao. 
(cherry picked from commit bee5a6a64a1c037308fa4d52249be39c82791590)
 2015-03-18 18:45:01 -07:00
Colin Patrick Mccabe
79c07bbaca HDFS-7054. Make DFSOutputStream tracing more fine-grained (cmccabe) 
(cherry picked from commit 8234fd0e1087e0e49aa1d6f286f292b7f70b368e)
 2015-03-18 18:15:17 -07:00
Karthik Kambatla
05627dd96d YARN-3351. AppMaster tracking URL is broken in HA. (Anubhav Dhoot via kasha) 
(cherry picked from commit 20b49224eb90c796f042ac4251508f3979fd4787)
 2015-03-18 16:33:57 -07:00
Haohui Mai
8eb97ea14e HDFS-7945. The WebHdfs system on DN does not honor the length parameter. Contributed by Haohui Mai. 2015-03-18 16:19:57 -07:00
Arpit Agarwal
ca629f4579 HDFS-7914. TestJournalNode#testFailToStartWithBadConfig fails when the default dfs.journalnode.http-address port 8480 is in use. (Contributed by Xiaoyu Yao) 2015-03-18 14:05:24 -07:00
Haohui Mai
572555c9f9 HDFS-7697. Mark the PB OIV tool as experimental. Contributed by Lei (Eddy) Xu. 2015-03-18 13:34:03 -07:00
Arpit Agarwal
e7ceb434d0 Fix CHANGES.txt for HDFS-7722. 2015-03-18 12:52:50 -07:00
Arpit Agarwal
6b7cf6e096 HDFS-7951. Fix NPE for TestFsDatasetImpl#testAddVolumeFailureReleasesInUseLock on Linux. (Contributed by Xiaoyu Yao) 2015-03-18 12:46:09 -07:00
Arpit Agarwal
97341a4a1d HDFS-7950. Fix TestFsDatasetImpl#testAddVolumes failure on Windows. (Contributed by Xiaoyu Yao) 2015-03-18 12:35:35 -07:00
Jason Lowe
24d8c6f355 MAPREDUCE-6277. Job can post multiple history files if attempt loses connection to the RM. Contributed by Chang Li 
(cherry picked from commit 30da99cbaf36aeef38a858251ce8ffa5eb657b38)
 2015-03-18 19:31:32 +00:00
Arpit Agarwal
a08b1b5703 HDFS-7948. TestDataNodeHotSwapVolumes#testAddVolumeFailures failed on Windows. (Contributed by Xiaoyu Yao) 2015-03-18 12:26:11 -07:00
Haohui Mai
b547e6d6e0 HDFS-7953. NN Web UI fails to navigate to paths that contain #. Contributed by kanaka kumar avvaru. 2015-03-18 11:08:29 -07:00
Harsh J
4e80c4cd5e MAPREDUCE-5807. Print usage for TeraSort job. Contributed by Rohith. 
(cherry picked from commit 9d72f939759f407796ecb4715c2dc2f0d36d5578)
 2015-03-18 17:31:25 +05:30
Akira Ajisaka
18740f9383 HADOOP-11659. o.a.h.FileSystem.Cache#remove should use a single hash map lookup. Contributed by Brahma Reddy Battula. 
(cherry picked from commit 34117325b29f0f1bdbe21343e7fd07e9ad0af907)
 2015-03-18 15:44:13 +09:00
Arpit Agarwal
7d0f84bd8d HDFS-7946. TestDataNodeVolumeFailureReporting NPE on Windows. (Contributed by Xiaoyu Yao) 2015-03-17 21:34:35 -07:00
Jian He
15ebacf03a YARN-3273. Improve scheduler UI to facilitate scheduling analysis and debugging. Contributed Rohith Sharmaks 
(cherry picked from commit 658097d6da1b1aac8e01db459f0c3b456e99652f)
 2015-03-17 21:31:20 -07:00
Tsuyoshi Ozawa
b00b216a91 YARN-3205. FileSystemRMStateStore should disable FileSystem Cache to avoid get a Filesystem with an old configuration. Contributed by Zhihai Xu. 
(cherry picked from commit 3bc72cc16d8c7b8addd8f565523001dfcc32b891)
 2015-03-18 11:53:40 +09:00
Aaron T. Myers
85473cd61a HADOOP-11722. Some Instances of Services using ZKDelegationTokenSecretManager go down when old token cannot be deleted. Contributed by Arun Suresh. 
(cherry picked from commit fc90bf7b27cc20486f2806670a14fd7d654b0a31)
 2015-03-17 19:42:31 -07:00
Jian He
ab34e6975b YARN-3305. Normalize AM resource request on app submission. Contributed by Rohith Sharmaks 
(cherry picked from commit 968425e9f7b850ff9c2ab8ca37a64c3fdbe77dbf)
 2015-03-17 13:50:44 -07:00
Karthik Kambatla
1e77d92d62 Revert "YARN-3181. FairScheduler: Fix up outdated findbugs issues. (kasha)" 
This reverts commit c2b185def846f5577a130003a533b9c377b58fab.

(cherry picked from commit 32b43304563c2430c00bc3e142a962d2bc5f4d58)
 2015-03-17 12:31:44 -07:00
Colin Patrick Mccabe
455d4aa8a1 HDFS-7940. Add tracing to DFSClient#setQuotaByStorageType (Rakesh R via Colin P. McCabe) 
(cherry picked from commit d8846707c58c5c3ec542128df13a82ddc05fb347)
 2015-03-17 11:01:42 -07:00
Jian He
1c601e492f YARN-3243. CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits. Contributed by Wangda Tan. 
(cherry picked from commit 487374b7fe0c92fc7eb1406c568952722b5d5b15)
 2015-03-17 10:25:07 -07:00
Devaraj K
895588b439 YARN-3197. Confusing log generated by CapacityScheduler. Contributed by 
Varun Saxena.

(cherry picked from commit 7179f94f9d000fc52bd9ce5aa9741aba97ec3ee8)
 2015-03-17 15:59:19 +05:30
Vinayakumar B
6ddb1bc857 HDFS-5356. MiniDFSCluster should close all open FileSystems when shutdown() (Contributed by Rakesh R) 
(cherry picked from commit 018893e81ec1c43e6c79c77adec92c2edfb20cab)
 2015-03-17 15:34:48 +05:30
Harsh J
c58786794b MAPREDUCE-4653. TestRandomAlgorithm has an unused import statement. Contributed by Amir Sanjar. 
(cherry picked from commit 75e4670408a058efa95eaa768fedbe614008658f)
 2015-03-17 14:13:23 +05:30
yliu
991ac04afc HDFS-7838. Expose truncate API for libhdfs. (yliu) 2015-03-17 07:24:20 +08:00
Tsuyoshi Ozawa
77297017d8 HADOOP-11720. [JDK8] Fix javadoc errors caused by incorrect or illegal tags in hadoop-tools. Contributed by Akira AJISAKA. 
(cherry picked from commit ef9946cd52d54200c658987c1dbc3e6fce133f77)
 2015-03-17 16:09:38 +09:00
Tsuyoshi Ozawa
bb828565f8 MAPREDUCE-5755. MapTask.MapOutputBuffer#compare/swap should have @Override annotation. (ozawa) 
(cherry picked from commit bb243cea93b6872ef8956311a2290ca0b83ebb22)
 2015-03-17 14:55:33 +09:00
Harsh J
5e403e8b8d MAPREDUCE-6100. replace mapreduce.job.credentials.binary with MRJobConfig.MAPREDUCE_JOB_CREDENTIALS_BINARY for better readability. Contributed by Zhihai Xu. 
(cherry picked from commit f222bde273cc10a38945dc31e85206a0c4f06a12)
 2015-03-17 11:08:32 +05:30
Harsh J
cbb8858367 HDFS-2360. Ugly stacktrce when quota exceeds. (harsh) 
(cherry picked from commit 046521cd6511b7fc6d9478cb2bed90d8e75fca20)
 2015-03-17 10:28:52 +05:30
Ravi Prakash
9f227ad696 YARN-3339. TestDockerContainerExecutor should pull a single image and not the entire centos repository. (Ravindra Kumar Naik via raviprak) 
(cherry picked from commit 56085203c43b8f2561bf3745910e03f8ac176a67)
 2015-03-16 16:18:42 -07:00
Tsuyoshi Ozawa
a20427d339 YARN-3349. Treat all exceptions as failure in TestFSRMStateStore#testFSRMStateStoreClientRetry. Contributed by Zhihai Xu. 
(cherry picked from commit 7522a643faeea2d8a8e2c7409ae60e0973e7cf38)
 2015-03-17 08:10:12 +09:00
cnauroth
ef2a66b246 Revert "HADOOP-11449 / HADOOP-10320 ; reverting patch 6cda3a7 which triggered regression in javadocs on some java8 compilers (stevel on behalf of cnauroth)" 
This reverts commit fe7df5b4d87298571da45562402976810899b6a9.

Conflicts:
	hadoop-common-project/hadoop-annotations/src/main/java/org/apache/hadoop/classification/InterfaceStability.java
 2015-03-16 14:31:35 -07:00
Suresh Srinivas
3a783fe38d HADOOP-8059. Add javadoc to InterfaceAudience and InterfaceStability. Contributed by Brandon Li. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354684 13f79535-47bb-0310-9956-ffa450edef68
(cherry picked from commit 24c4216bf0d75006fb218d743183f96658bea65c)

Conflicts:
	hadoop-common-project/hadoop-common/CHANGES.txt
 2015-03-16 14:21:15 -07:00
Yongjun Zhang
d684b21ada HADOOP-11692. Amendment to CHANGES.txt. 2015-03-16 14:11:58 -07:00
cnauroth
f492fc7b2c HADOOP-11638. OpensslSecureRandom.c pthreads_thread_id should support FreeBSD and Solaris in addition to Linux. Contributed by Kiran Kumar M R. 
(cherry picked from commit 72cd4e4a4eb2a9f8695d4c67eb55dd2be36c52dc)
 2015-03-16 14:05:05 -07:00
Harsh J
0e9f78dda2 MAPREDUCE-6105. nconsistent configuration in property mapreduce.reduce.shuffle.merge.percent. Contributed by Ray Chiang. 
(cherry picked from commit 26a23b11598b3757ed4973781890e2cd2fc270df)
 2015-03-17 02:27:33 +05:30
Konstantin V Shvachko
4568acaa62 HDFS-7886. Fix TestFileTruncate falures. Contributed by Plamen Jeliazkov and Konstantin Shvachko. 2015-03-16 12:55:16 -07:00