recommendation engine - Performance Issue with Item-Based Recommender in Mahout -

-

i trying use item based recommender in mahout. contains 2.5 m user,item interaction, without preference values. there around 100 items , 100k users.it takes around 10s recommend. whereas same data takes less second when use user based recommender.

itemsimilarity sim = new tanimotocoefficientsimilarity(dm);  candidateitemsstrategy cis = new samplingcandidateitemsstrategy(10,10,10,dm.getnumusers(),dm.getnumitems()); mostsimilaritemscandidateitemsstrategy mis = new samplingcandidateitemsstrategy(10,10,10,dm.getnumusers(),dm.getnumitems()); recommender ur = new genericbooleanprefitembasedrecommender(dm,sim,cis,mis);

i read 1 of answer of @sean suggests using above parameters samplingcandidateitemsstrategy. not sure does.

edit: 2.5 m total user-item associations, there 100k users , total number of items 100.

among many reasons, main reason choosing item-based recommender is: if number of items relatively low compared number of users, performance advantage significant. goes other way around too. if number of users relatively low compared number of items, choosing user-based recommendation result in performance advantage.

from question did not number of items in dataset, number of users. once mention 2.5m , 100k? in case if user-based recommendation faster you, should choose approach.

except, if item-item similarities more fixed (not expected change radically or frequently), better candidates precomputation. precomputation , used precomputed similarities between items.

also, since don't have preference values, , if want use item-based similarity, can think of enriching similarity function pure item-item similarity based on characteristics of items. (this idea).


Comments

Post a Comment

Popular posts from this blog

python - Subclassed QStyledItemDelegate ignores Stylesheet -

-
i'm trying subclass qstyleditemdelegate remove focus rectangle in qcombobox . even though i'm calling base implementation of paint function , nothing else, result different. looks if parts of style-sheet influence bounding box of item taken consideration. class pstyleditemdelegate(qstyleditemdelegate): def __init__(self, *args, **kwds): super(pstyleditemdelegate, self).__init__(*args, **kwds) def paint(self, *args, **kwargs): qstyleditemdelegate.paint(*args, **kwargs) what have paint unmodified qstyleditemdelegate ? as suggested tried replacing pyside pyqt4 , works, appears bug. update pyside 1.1.2 1.2.1 result same. unfortunately switch breaks other parts of code, if there no other suggestions i'm going accept answer. edit bug tracked here
Read more

java - HttpClient 3.1 Connection pooling vs HttpClient 4.3.2 -

-
i have used httpclient3.1(java) connection pooling below : import org.apache.commons.httpclient.httpclient; import org.apache.commons.httpclient.multithreadedhttpconnectionmanager; import org.apache.commons.httpclient.params.httpclientparams; import org.apache.commons.httpclient.params.httpmethodparams; import org.apache.log4j.logger; public class httpclientmanager { private static logger logger = logger.getlogger(httpclientmanager.class); private static multithreadedhttpconnectionmanager connectionmanager = new multithreadedhttpconnectionmanager(); private static httpclientparams clientparams = new httpclientparams(); static { try { clientparams.makelenient(); clientparams.setauthenticationpreemptive(false); clientparams.setparameter(httpmethodparams.so_timeout, new integer(30000)); // set so_timeout clientparams.setparameter(httpmethodparams.head_body_check_timeout, new integer(3000)); // head responses ...
Read more

node.js - StackOverflow API not returning JSON -

-
i using node.js script gather data stackoverflow. know responses gzipped, put code in should take care of that. script follows: var request = require('request'); var zlib = require('zlib'); function getstackoverflowresponse(url, callback){ request(url, {encoding: null}, function(err, response, body){ if(response.headers['content-encoding'] == 'gzip'){ zlib.gunzip(body, function(err, dezipped) { callback(dezipped); }); } else { callback(body); } }); } var url = "https://api.stackexchange.com/docs/questions#pagesize=2&order=desc&min=2014-01-04&max=2014-02-02&sort=activity&tagged=apigee&filter=default&site=stackoverflow&run=true"; getstackoverflowresponse(url, function(questions) { console.log(questions); }); instead of getting json output, i'm getting following response: buffer 0d 0a 0d 0a 0d 0a 0d 0a 3c 21 44 4f 43 54 59 50 45 20 48...
Read more