[#ZF-2358] Zend_Service_Yahoo::webSearch 'site' option

Zend Framework

Zend_Service_Yahoo::webSearch 'site' option

Created: 27/Dec/07 10:05 PM Updated: 15/Sep/08 02:52 PM

Component/s:

Zend_Service_Yahoo

Affects Version/s:

1.0.3

Fix Version/s:

Next Mini Release

Time Tracking:

Not Specified

Fix Version Priority:

Should Have

Description

« Hide

The 'site' option of Zend_Service_Yahoo::webSearch does not work. Whenever it is specified, nothing is returned.

For example, when searching for "mysql" on "www.php.net", many results are returned:

http://search.yahoo.com/search;_ylt=A0geu9VfanRHn3MApo1XNyoA?p=site%3Awww.php.net+mysql&y=Search&fr=sfp&ei=UTF-8

Similarly, calling the REST API directly returns results:

http://search.yahooapis.com/WebSearchService/V1/webSearch?appid=YAHOO_ID&query=mysql&results=10&site=www.php.net

However, doing the same with "Zend Framework 1.0.3", nothing is returned.

Using PEAR's Services_Yahoo_Search component, the results are returned correctly.

Sample Code:

// ----------------------------------------------------------------------

// Zend Framework 1.0.3

include_once 'Zend/Service/Yahoo.php';

$yahoo = new Zend_Service_Yahoo('YAHOO_ID');

$results = $yahoo->webSearch('mysql', array('site' => 'www.php.net'));

foreach ($results as $result)
{
    echo $result->Title . '<br />';
}

echo "<hr />";

// ----------------------------------------------------------------------

// PEAR

include_once 'Services/Yahoo/Search.php';

$yahoo = Services_Yahoo_Search::factory('web');
$yahoo->setAppId('YAHOO_ID');
$yahoo->setSites(array('www.php.net'));
$yahoo->setQuery('mysql');

$results = $yahoo->submit();

foreach ($results as $result)
{
	echo $result['Title'] . '<br />';
}

All

Comments

Work Log

Change History

FishEye

Crucible

Sort Order:

Ascending order - Click to sort in descending order

[ Permlink | « Hide ]

Simone Carletti - 28/Dec/07 05:23 PM

I investigated the issue.
Here's a few notes:

This is the URI queried by Zend_Service_Yahoo
http://search.yahooapis.com/WebSearchService/V1/webSearch?type=all&start=1&language=en&license=any&results=10&format=any&site=www.php.net&appid=API_KEY&query=mysql

I tried to remove each default parameter and I discovered license parameter can cause some problem when site is not empty, even if any is the default value.
I would suggest to remove the default value and left the parameter empty.

[ Permlink | « Hide ]

Kevin Golding - 11/Jan/08 12:40 PM

Interesting this query has the "any" license set but returns 511 results:

http://search.yahooapis.com/WebSearchService/V1/webSearch?type=all&start=1&language=en&license=any&results=10&format=any&site=www.flickr.com&appid=API_KEY&query=mysql

All that changed is the site searched against. It seems Yahoo aren't consistent in their handling of the matter.

[ Permlink | « Hide ]

Wil Sinclair - 21/Mar/08 05:05 PM

This issue should have been fixed for the 1.5 release.

[ Permlink | « Hide ]

Jonathan Maron - 11/Apr/08 02:28 AM

It seems that in Zend Framework 1.5.1, the problem is still not solved.

The following code does not return any results:

// Zend Framework 1.5.1

include_once 'Zend/Service/Yahoo.php';

$yahoo = new Zend_Service_Yahoo('YAHOO_ID');

$results = $yahoo->webSearch('mysql', array('site' => 'www.php.net'));

foreach ($results as $result)
{
    echo $result->Title . '<br />';
}

echo "<hr />";

Removing the ", array('site' => 'www.php.net')" part of "webSearch" and executing again, returns results.

I personally think that Zend_Service_Yahoo::webSearch, with the 'site' option is a great way to implement a "site search" feature on anyway.

[ Permlink | « Hide ]

Kevin Golding - 11/Apr/08 03:33 AM

All the testing I've done suggests there's an inconsistency at Yahoo's end. I think "fixing" it in ZF will be more a case of adding workarounds and exceptions to wrangle the results when we hit bad resultsets like mysql on php.net.

[ Permlink | « Hide ]

Wil Sinclair - 18/Apr/08 01:11 PM

This doesn't appear to have been fixed in 1.5.0. Please update if this is not correct.

[ Permlink | « Hide ]

Simone Carletti - 13/May/08 03:30 PM

@ Jonathan Maron
AFAIK nothing has been done to fix the issue for ZF 1.5 thus it's normal the issue still appears.

If I have a few minutes in the next days I'll give it a look.
Needless to say, patches are always welcomed from everyone.

[ Permlink | « Hide ]

Wil Sinclair - 02/Jun/08 06:29 AM

Simone, could you please look at this and fix the bug or close the issue? Time to get some closure.

Thanks!
,Wil

[ Permlink | « Hide ]

Simone Carletti - 04/Jun/08 03:52 AM

Hi Wil,
I'll try to give it a look.

[ Permlink | « Hide ]

Milan Momcilovic - 21/Jun/08 11:17 AM

Hi all,

The license parameter causes problems. I tested the Yahoo web search service from my browser using the following URI:

http://search.yahooapis.com/WebSearchService/V1/webSearch?appid=YAHOO_API_KEY&query=Godfather&results=2&license=any

IMO, this should return the results from IMDB but it returns only results from Digg, which the license option ('license=any') does not work correctly.

When license parameter is not used at all, the correct results are returned - try this:

http://search.yahooapis.com/WebSearchService/V1/webSearch?appid=YAHOO_API_KEY&query=Godfather&results=2

Therefore, I think that the "license" option should be removed from $defaultOptions for now, until Yahoo guys fix this problem.

Thanks,
Milan